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The aim of this book is stated in detail in the intro- 
duction. In short, it is an attempt to present, free from 
its usual accompaniment of statistical methods, the new 
idea of educational measurement by means of objective 
scales. This book will not satisfy the statistically trained 
reader, for to such its methods will appear climisy and 
inelegant. However, not every member of the teaching 
profession can be expected to have statistical training ; yet 
it is essential that every one in school work have the quan- 
titative point of view. If this small book succeeds in in- 
troducing the reader to the new movement of which the 
objective scales are the product, it will in a large measiu^ 
make up for its obvious shortcomings. 

It is our pleasure to record our obligations to the fol- 
lowing for their courtesy in permitting us to quote their 
original papers and reproduce their scales : 

Dr. L. P. Ayres (Handwriting and Spelling Scales). 

Dr. F. W. Ballou (English Composition Scale). 

Dr. B. R. Buckingham (Spelling Scales). 

Mr. S. A. Courtis (Arithmetic, Writing, and Reading 



Mr. W. S. Gray (Reading Scale). 
Dr. M. B. Hillegas (English Composition Scale). 
Dr. Daniel Starch (Reading and Spelling Scales). 
Dr. E. L. Thomdike (Handwriting, Reading, and 
Drawing Scales). 
Dr. M. R. Trabue (Language Scale). 
Dr. C. Woody (Arithmetic Scale). 

312143 
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The full references to these original papers are given 
in the Appendix. We are also under obligation to Dr. 
H. Austin Aikins and Miss Mjrra E. Hills for reading 
parts of the manuscript. 

One of the authors wishes to express his great indebted- 
ness to Dr. E. L. Thomdike, from whose writings the 
ideas embodied in this book largely originated. 

J. i^. \j» 

G. P. R. 

Western Reserve University, 

1917. 
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'Are you content now?" said the CaterpUlar. . 
Well, I should like to be a little larger, if you wouldn't 
mind," said Alice. "Three inches is such a wretched 
height to be." 

" It is a very good height indeed ! " said the Caterpillar 
angrily, rearing upright as it spoke (it was exactly three 
inches high). 

— Lewis Carroll. Alice in Wonderland. 
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THE AIM OF THE BOOK 

It may safely be said that the greatest contribution 
which has been made to education in the last ten years 
is the application of scientific measurement to school. 
products. The new educational method which has re- 
sulted shows a clear recognition of the scientific spirit. ' 
That a new method was needed was generally agreed, 
and it has been accepted by those who have experimented 
with it. However, there is always danger when those 
engaged in the practice of a subject are for any reason 
unacquainted with the latest advances. This is clearly 
demonstrated in a field such as medicine, where it often 
takes years for a principle which has been accepted by the 
leaders in the profession to be put into practical applica- 
tion by the general practitioner. Particularly is this true 
in the field of education, for any desired advance depends 
on the closest cooperation of the theorist and the teaching 
force, largely because the classroom is the laboratory of 
the experimental educationalist. It is the general belief 
that the teacher is interested and eager to know what 
degree of success his efforts have won, as measured by 
the quality of the work done by his pupils. The diffi- 
culty which, up to the present time, has confronted the 
teacher has been the fact that methods for the measure- 
ment of school products have been so complicated with 
vil 
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statistical data that it has been ahnost impossible for the 
ordinary reader to comprehend the movement, and still 
more impossible for the teacher to apply these methods 
in the classroom. It is the object of this book to present, 
in a manner free from statistical data and other compli- 
cated material, a few of the more important scales which 
have been worked out and which can profitably be used 
in the course of ordinary school work by any teacher 
without special training. No attempt has been made 
to give a complete presentation of a subject which has 
been so recently developed, and which is still passing 
through the experimental stage. The authors have 
chosen to describe the method of construction of a few of 
the more important scales rather than to cover all scales 
which have been published up to the present time. Pro- 
vided the reader becomes acquainted with the general 
idea of this scientific movement by using the scales here 
described, there is no danger that he will fail to use new 
scales as they are developed. 

Everjrthing has been sacrificed to clearness ; even uni- 
formity in the method of presentation has had to give 
way, where such uniformity would have resulted in lack 
of clearness. 

Each scale has been presented as a unit. This has 
made necessary a certain amount of repetition, but the 
advantages of the method are apparent. 



THE SCIENTfflC MEASUREMENT OF 
CLASSROOM PRODUCTS 



OBJECTIVE VERSUS SUBJECTIVE SCALES OF 
MEASUHEMEHT 

MoEE and more, as we come to analyze the educa- 
tional process, the old idea that this process goes on as 
a whole is being abandoned. In spite of obvious dangers, 
the more enlightened view regards the education of any 
particular individual as the conscious attempt of society 
to make that individual advance along certain desirable 
paths — the desirability of any particular path being de- 
termined by the capacity of the individual and the demanda 
of society. 

Along some lines the school insists that every pupil 
shall advance; for example, he must improve along the 
lines of activity which for convenience are termed arith- 
metic, writing, reading, English composition, spelling,' 
drawing, etc. If we regard the pupil as advancing simul- 
taneously along all these partly independent lines, we need 
not, and for many purposes should not, regard education 
as a single process but rather as a series of processes, each 
of which, when recognized, admits of study by any per- 
son who is prepared to take the time to specialize m that 
dhBction. Even such aims as the school has in regard to 
the building of character must, in the same way, be re- 
garded as an attempt on the part of the school to make 
the pupils improve on a moral scale, which at present 
CHsts merely in thought. 
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If those interested in education would consistently take 
this analytical position, there would be a great change of 
attitude towards educational problems. For when we 
look at education as some large general process, the task 
of improving that process appears rather formidable ; but 
when it is seen that general improvement is merely ad- 
vance in certain specific and narrow directions desired by 
society, the problem of advance becomes, comparatively 
speaking, a simple one. There still remains the great 
question of what activity is the most desirable; this 
question must be left as one of the fundamental problems 
of the philosophy of education. When, however, it has 
been decided that a certain line of activity must be pur- 
sued in the schools, then the question and problem for 
the ordinary teacher b this : How can I most efficiently 
train the pupils to improve in skill along this line? 
What method should I adopt to bring the child to a 
reasonable efficiency in the minimum time? That is, 
from the point of view of the teacher there is often no 
doubt of what has to be done, the problem being, how 
can the result be accomplished with the greatest economy 
of effort in the minimum time. In other words, it is not 
so much a matter of wkai to teach, as of what method shall 
be used in teaching. 

But when it comes to a choice between the various 
methods of teaching a given subject, what is to be the 
criterion? Is it to be the opinion of the teacher, or of 
the supervisor, or of the superintendent? If so, on what 
is this opinion based? In education, the time has passed 
when the inventor of a certain system can make un- 
challenged claims with regard to the success of his method ; 
for in many subjects it is now possible to measure, under 
scientific conditions and independently of any individual 
judgment, the results obtained under various methods. 
In this way there is arising a science of method founded 
on the secure basis of accurate measurement of results. 
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The first essential, then, for the teacher, if sound judg- 
ment of the success of classroom instruction is to be 
secured, is to have some scientific methods of measuring, 
at intervals, the increase of skill or the improvement of 
the class along the lines of activity for which that teacher 
is responsible. Just as in a gymnasiimi it is possible to 
measure the increase in height from month to month or 
from year to year by means of a scale of height, so inthe 
school the teacher must be able to measure the rate of 
improvement of pupils in the various subjects taught. 

This really is no new idea in education ; the school has 
always been more or less interested in measurement, as 
the common practice of examinations proves. It is not a 
question of whether we are to measure the efficiency of the 
pupils or not, but rather kow we are to measure this effi- 
ciency. Shall the judgment be the opinion ^ frequently 
offhand or prejudiced — of some one individual ; or shall 
the judgment be determined by the use of a standard de- 
vised by and based upon the consensus of opinion of many 
experts? If the results of classroom work are to be 
measured with any degree of exactness, then what we 
need are scales for measurement, scales which are as inde- 
pendent as possible of the judgment of the individual who 
uses them. 

The question, therefore, of urgent importance, is : 
What are the present methods of measm-ing efficiency in 
the schools, and how satisfactory are these methods? It 
is true that there is perhaps no part of the teacher's work 
which he knows to be more unsatisfactory than the usual 
method of awarding grades and marks. Two methods ^ 
are now in vogue; namely, the percentage method, and 
the letter mark method. In the former the pupil's work 
is graded on a basis of 100 as the standard ; in the latter, 
a letter such as E, G, F, is given to indicate a certain 
degree of efficiency. 

In a recent article in the EducatioTial Review a well- 
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known writer makes the statement: "85% as a class 
average in subjects like arithmetic or grammar is not 
excessive." This statement may be true or false, but in 
any case it is valueless, for the simple reason that a mark 
of 85% never means the same standard to one individual 
that it does to another. In a reply to this article one 
writer states : "What 85% means is absolutely unknown 
and unknowable — guot homines tot sententiae!" The 
same argument applies to a grading indicated by letter, 
- What guarantee is there that the same grading represents 
the same standard of work, when measured by different 
individuals? All attempts which have been made to in- 
vestigate this subject prove conclusively that, even in the 
same school, two teachers will often give the same grading 
for work which is by no means equivalent. What, then, 
is wrong with such scales of marking? Obviously, the 
errors that arise from their use are due to the fact that 
■ they depend too much on the individual judgment of the 
teacher, or, in other words, that the scales are too sub- 
jective. 

Opinions of teachers on handwriting form an excellent 
illustration of the dangers and disadvantages of subjective 
judgments. When a teacher says of a particular sample 
of writing that it is "good," "fair," "poor," not only does 
this judgment fail to give an absolute measure of effi- 
ciency, but even the judgment itself is largely determined 
by the extent to which the teacher is partial to such 
characteristics as legibility, grace, character, or to various 
styles of writing, such as slanting or vertical. In the 
writing scale to be described, a successful attempt has 
been made to eliminate this type of unscientific judgment. 

In opposition to these subjective scales of measurement, 
which depend so much upon the judgment of the individual, 
there are scales such as those used in measuring mass, 
length, or time. In the use of these objective scales, 
very little depends on the judgment of the individual. 
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When one says that a particular body weighs 14.6 pounds 
or that the length of a certain rod is 18.1 feet, there is no 
room for dispute, since such measurements are outside the 
range of personal opinion. In other words, they are what 
we call universal or objective, for they mean the same thing 
to all persons at all times and in all places. On the con- 
trary, judgments of plays, books, moral characteristics, 
depend very much on the character and taste of the in- 
dividual . The designation ' ' good ' ' used by different 
individuals may mean very different degrees of merit; 
that is, the judgments are subjective. In the light of what "M 
we have said we may define a perfectly objective scale as 
a scale in respect to whose meaning all competent thinkers 
agree ; while a perfectly subjective scale is one in respect 
to whose meaning all those competent to judge would be 
likely to disagree, save by chance. 

When subjective scales, such as those described, are 
used in schools, it is evident that we can have no scien- 
tific basis for comparison. Yet all agree that improve- 
ment and advance depend largely upon critical compari- 
son. Up to the present time, therefore, one of the great 
methods of obtaining efficiency in the outside world, has 
not been employed in education, because critical com- 
parison could not safely be based on subjective judgments. 
When objective scales are employed in the schools, then 
it will be feasible to compare the work done in one school 
with the work done in another, or the work done under 
one method of instruction with the work done under a 
different method. Even now, in certain subjects the 
school administrator is able to compare teacher with 
teacher, school with school, s3^tem with system, and even 
country with country. 

The great problem of measurement in education, there- 
fore, is to construct objective or universal scales, about 
the use of which there can be no misunderstanding when 
they are placed in the hands of competent teachers. 
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Every such scale must fulfill at least three essential re- 
quirements: (!) It must measure a desired product; 
(2) it must be so simple in its application that it is suit- 
able for ordinary classroom use ; (3) it must not require 
an undue amount of time in administration. 

From the very nature of measurement it is apparent 
that ability in such a subject as arithmetic admits of being 
measured objectively. Any competent teacher would be 
capable of constructing a scale to measure improvement 
in addition. But the essential thing is that every one 
shall agree to use the same method, or standard, just as 
they agree to use a gram, a centimeter, and a second in 
measuring mass, length, and time. Thus, suppose it is 
desired to measure speed in adding, al! that is necessary 
is to construct a blank on which are printed the columns 
of figures. The test can then be administered by allow- 
ing, let us say, two minutes for the work, that is, less 
time than it takes even the fastest pupil to complete all 
the addition. Provided the same directions are followed 
in each case, it is possible to measure by the same stand- 
ard any other school in any other system. In this way a 
comparison of the two groups will be perfectly easy. The 
essential point, then, is that all shall agree to use the same 
scale, under the same conditions, giving the same time 
allowance, and correcting and scoring in the same way. 
It is to fulfill these conditions that objective scales are 



While arithmetic lends itself to such objective measiire- 
ments, in other important subjects it is more difficult to 
construct scales for the measurement of efficiency, which 
will be relatively independent of the judgment of the 
teacher. It would be ideal if scales could be constructed 
which would measure improvement in writing, reading, 
drawing, English composition, spelling, etc., about the 
use of which there would be as little division of opinion 
aa there is about the employment of a yardstick, a balance, 
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Objective versus Subjective Scales 7 

or a watch, to measure length, mass, and time, respec- 
tively. In the following pages a few of the more essential 
objective scales which have been worked out with this 
idea in view, will be presented. No claim is made that 
they eliminate completely the factor of the judgment of 
the individual teacher. Through the description and use 
of the scales themselves the reader may judge of the extent 
to which individual opinion, bias, and prejudice, as fac- 
tors, have been excluded. 

It will be seen that a scale may be used by the teacher 
merely to measure the improvement of a particular class 
or individual. It is advantageous, however, after a par- 
ticular test has been administered, to know how the grade 
taking the test compares with similar grades in other 
school systems. In certain cases it is possible to make 
this comparison, for the scales have been tested with a 
sufficient number of pupils to establish averages of achieve- 
ment, or, in other words, norms or standards for the various 
grades. The process of at-ati dardizing a test is quite 
simple. All that is necessary is to administer the test, 
under the identical standard conditions, in like grades, in 
different representative school systems, and from these 
results to determine the average work done in the various 
grades. It will be noted, from what follows, that we do 
not have a different scale for each grade, for in many cases 
all grades can be measured by the same scale. Just as 
we measure the dwarf and the giant with the same foot 
rule, and express the result in the same unit, inches, so 
we may measure the ability of individuals at different 
points of their training on the same scale, expecting of 
course increasing products at successive stages. In so far 
as standards have been established for the grades, they 
are included in the description given in the following chap- 
ters (II-VIII). In all cases these standards or norms must 
be looked upon as provisional, for none of the tests have 
been tried upon a sufficiently wide range of schools and 
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school systems to make it certain that the standards are 
the average achievements of the particular grade in 
question. 

EXERCISES 

1. What are the present methods by which you measure the eiB- 
ciency of your class work? Why is it so difficult to tell how your 
class compares with other classes of the same grade? How would 
such information increase your efhciency? 

2. Taking twenty compositions of varying merit, grade them 
according to your usual method. Put them away for a month and 
then grade ag^n. How do the results compare ? Repeat the eiperi- 
mentwith a series of handwriting samples. 

3. Does the same mark given by different teachers imply the same 
standard of work on the part of the pupils? How would you prove 
the correctness of your answer? 

4. What is the final test of any particular method of teaching a 
subject? Why is there so mucb diflerence of opinion with reference 
to the relative values of different methods? 

5. What would happen if a foot meant a different length in dif- 
ferent parts of the country? What is the effect of 80% in one school 
not meaning the same as 80% in another school? 

€. Give ten examples of qualities which we measure (a) objec- 
tively; (6) subjectively. la there any such thing as a perfect 
objective measure? Give your reasons. 

7. What is meant by a norm? Howwould you establish the norms 
of height and weight of the grades in a school? How could we use 
the flame idea in measuring growth in spelling, arithmetic, writing, 
and reading skill? What are the difficulties? 

8. What are the disadvantages of the present system of subjective 
marking as they affect (a) the pupil ; (b) the teacher ; (c) the adminis- 
tration of the school system? 

9. It has been shown that the same arithmetic paper received 
85% and 40% when marked by two trained judges; how could 
this happen? What might have been done to avoid it? 

10. If you had GOOO arithmetic papers, and five judges bad each 
to mark lOOO of these, how would you attempt to secure uniformity 
in the Bystem of markiiigT 



CHAPTER II 

ARITHMETIC SCALES 

I. COURTIS TESTS IN ARITHMETIC 
n. WOODY TESTS IN ARITHMETIC 

When it is considered how many diflferent operations 
are covered by the inclusive term "arithmetic/' it be- 
comes apparent at once how little specific meaning is con- 
veyed by the assertion that a pupil is good or poor in that 
subject. Since arithmetical skill is not a single ability, 
but consists rather of a number of abilities, discussion of 
it should be expressed in terms of these. For instance, 
instead of saying that a child is good in arithmetic, it is 
more accurate and far more useful to state in what specific 
process or processes — adding, subtracting, reasoning, etc. 
— he excels, for a child may be good in one of these opera- 
tions and poor in another. Thus, the teacher is con- 
fronted with a problem of analysis. It must be discovered 
first of all in what particular process — adding, multiplying, 
subtracting, etc. — the pupil is weak, and then an attempt 
must be made to strengthen him in that process. To facili- 
tate this work is the chief object of the Courtis Tests in 
Arithmetic. 

Eight or nine years ago, in an early effort to meas- 
ure efficiency in certain phases of arithmetical work, 
Courtis discovered that the ability of a given individual 
in some one process was very different from his ability 
m another. One child might be very good in addition 
and poor in multiplication, while another might be good 
in both addition and multiplication but poor in reasoning, 
etc. Courtis immediately began experimental work to 
control this individual variation; that Is, to make the 

9 
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child do equally well in all these operations. For several 
years the attempt failed ; for with his increased effort at 
control, Courtis found that the difference in the ability 
of the mdividual m the various branches also increased. 
However, this work was not without most important re- 
sults. As an outcome of administering the tests to more 
than 48,000 children in about 70 schools in 10 states, 
Courtis discovered one fundamental fact; namely, that 
one of the great factors in education is the variability of 
the natural abilities of children. In the first place, no 
child will do equally well in all the operations involved in 
arithmetic ; for example, he may do very well in division 
and still do poorly in addition, or vice versa. That is, 
there is a difference among his special attainments or 
abilities in these sub-branches. Secondly, there exists a 
great difference in the general ability of different children. 
According to Courtis, these two facts mean that new edu- 
cational methods, methods that will give each child a 
chance to develop in his own way and along his own lines, 
will have to be invented. In the work of analysis thus 
necessitated, the Courtis Tests will be of great assistance. 
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L COURTIS TESTS 

These original tests, called by Courtis " Series A," are 
eight in number and are designed to test those abilities 
which constitute most of that complex product known as 
arithmetical eflSciency. 

Courtis Tests — Series A 



NUIIBBB 

or Tb8T 


FuNonoN Tma vob ADimnsTBA' 

HON or Tbbtb 


1 


Addition 1 


One minute 


2 


Subtraction Combinations 


« « 


3 
4 


MultipUcation j 0-9 
Division 




6 
6 

7 


Copying Figures 

(Rate of motor activity) 
Speed Reasoning 

(Judgments of operation to be used in 
simple one-step problems) 
Fundamentals 


4€ U 

Twelve minutes 


8 


(Abstract examples in the four opera- 
tions) 
Reasoning 
(TwoHstep problems) 


Six 



These eight tests are printed on separate sheets of paper, 
and folders, containing full directions intended to secure 
uniformity of administration and marking, may be had 
by the examiner. For example, in the Addition Test 
given on page 12, the child is supposed to add across the 
paper from left to right. That is, his answers should be, 
9, 18, 13, 8, etc. He should do as many of these prob- 
lems as possible in the time allowed — one minute — 
and his score will be the number of problems he has done 
correctly in that time. 
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Arithmetic — Test No. i Speed Test — Addition 

Write on this paper, in the spax*e between the lines, 
the answers to as many of these addition examples as 
possible in the time allowed. 

89782 13603 17932 16904 
19605 58972 37604 26512 



58694 12567 34703 14802 
13503 49802 16985 67957 



18605 48953 13823 29745 
94724 18706 79507 2 3802 



37904 24516 92506 74803 
3486518902 18743 19604 



69812 16702 59675 48507 
14713 84536 52803 42693 



14904 12603 89785 17932 
67512 67972 19602 37604 



{CopurigU b^ 8. A. Coilrtia) 
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The same mode of procedure applies to the Subtraction, 
Multiplication, and Division Tests. 

In the test of reasoning with one-step problems (Test 
No. 6), the pupil is not required to work out the prob- 
lems but merely to record what operation — addition, 
subtraction, etc. — he would use if he were going to work 
them out ; this is to distinguish between skill in reason- 
ing and mere skill in rapid calculation. In the reasoning 
test involving two steps (Test No. 8), the answer is to be 
found and recorded. 

The tests just described were designed to measure the 
relation existing between the simpler abilities tested in the 
first six tests and the more complex abilities tested in 
the last two tests. That is, their object was to investigate 
whether a child who is good or poor in addition, subtrac- 
tion, multiplication, or division is also good or poor, as 
the case may be, in fundamentals and reasoning. Courtis 
claims the tests have accomplished this purpose. 
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Arithmetic — Test No. 7 — Fundamentals 

In the blank space below, work as many of these ex- 
amples as possible in the time allowed. Work them in 
order as nmnbered, writing each answer in the "answer 
colmnn" before commencing a new example. Do not 
work on any other paper. 



No. Opbbation 

1 Addition 



EXAMFLB AHBWBB 

a. 25 + 830 + 122 = 

6. 232 + 8021 + 703 + 3030 = 



2 Subtraction 



a. 5496 - 163 = 

6. 943276 - 812102] = 



3 Multiplication 

4 Division 

5 Addition 

6 Subtraction 

g| Multiplication 



9 Division 
J j| Division 



12 
13 



I Addition 



14 Subtraction 
Jg I Multiplication 
17 Division 
Jgj Division 



2012 X 213 = 

158664 -^ 132 = 

6134 + 213 + 4800 + 6005 + 474 

73210142 - 49676378 = 

46505 X 456 = 

27217182 -^ 6 = 

3127102 -^ 463 = 
85586 + 69685 + 39397 + 
95836 + 37768 + 69666 + 
78888 + 54987 = 
15655431 - 5878675 = 

78965 X 678 = 

44502486 -5- 7 = 

5373003 -^ 769 = 



(Copy^^ ^ <S>. A. CourHs.) 






Arithmetic — Test No. 8 ^ Reasoning 
In the blank space below, work as many of the following 
examples as possible in the time allowed. Work them in 
order as numbered, entering each answer in the "answer 
column" before commencing a new example. Do not 
work on any other paper. 

1. A party of children went (rom a achool to a woods to gather 
nuta. The number found was but 205, so they bought 1,955 nuts 
more from a farmer. The nuta were shared equally by the children 
and each received 45. How many children were there in the partyT 

2. One summer a fanner hired 43 boys to work in an apple orchard. 
There were 35 trees loaded with fruit and in 57 minutes each boy had 
picked 49 apples. It In the beginning the total number ot apples on 
the trees was 19,677, bow many were there etill to be picked? 

3. A girl found by careful counting that there were 87 letters more 
on a page in her history than on a page of her reader. She read 31 
pages in each book in the first 29 days of school. Bow many more 
letters each day did ahe read in one book than in the other? 

4. The children of a school made small boxes to be tilled with 
candy and given as presents at a school party. Six hundred were 
needed. In 4 days grades III to VII made 20, 25, 83, 150 and 150 
boxes. The eighth grade agreed to make the rest. How many did the 
eighth grade make? 

6. A girl's record in spelling for 5 days was 19, 18, 20, 16 and 20 
words spelled correctly out ot 20. It each of the 16 children in the 
grade had had the same record, what would have been the total num- 
ber of words spelled correctly by that grade in 5 days? 

6. A party of boys went on a long bicycle trip. They traveled 
1702 miles in 37 daya, A number of men then joined the party, and 
Hoon the party was traveling 58 miles per day. How much change 
in the number of miles ridden a day did the presence of the men make? 

7. A teacher corrected 2400 arithmetic teat papers; 2295 ot these 
he marked "poor," "good" etc. All the others were marked "un- 
satisfactory." If each of the papers in this group had 47 mistakes, 
what was the total number of mistakes in the unsatisfactory papers? 

8. In two schools five teachers recorded the number of blocks the 
children walked in going to and from the school. The total for one 
school was 3000 blocks ; for the other 2400. The number of children 
in both schools was 216. How many blocks did each child walk a 

(Copyright bv S. A. CouTlit) 
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Courtis Tests— Series B 

Courtis has recently constructed a new series of more 
difficult tests, " Series B," to be used in the primary grades 
for testing more complex operations in the four fimda- 
mental processes. The figures in these tests are chosen so 
that all the fimdamental combinations are included. 



NiTMBBB or 

Tbbt 


FuNonoN 


TnnB POB AdhinistbA' 
HON OF Tests 


1 

2 
3 

4 


Addition 
Subtraction 
Multiplication 
Division 


Eight minutes 

Four 

Six 

Eight " 



In the Addition Test the pupil is required to add as 
many figures as possible in eight minutes. In this way it 
may be determined whether or not a child or class has 
learned (1) the fimdamental combinations ; (2) the mechan- 
ism of column addition; (3) to carry; (4) to hold the 
attention; (5) to control the effects of fatigue or bore- 
dom; (6) to work at a high speed; (7) to work with 
accuracy. In a similar manner, each of the other three 
tests is put in the simplest form necessary to serve as a 
general measure of ability in that operation. 

Test No. I — Addition 

You will be given eight mmutes to find the answers to 
as many of these addition examples as possible. 



927 


297 


136 


486 


384 


176 


277 


837 


379 


925 


340 


765 


477 


783 


445 


882 


756 


473 


988 


524 


881 


697 


682 


959 


837 


983 


386 


140 


266 


200 


594 


603 


924 


315 


353 


812 


679 


366 


481 


118 


110 


661 


904 


466 


241 


851 


778 


781 


854 


794 


547 


355 


796 


535 


849 


756 


965 


177 


192 


834 


850 


323 


157 


222 


344 


124 


439 


567 


733 


229 


953 


525 



^Copyright hy S. A. CourUa) 
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Series B may be used from the fourth grade up. When 
these four tests are standardized, which will take place 
as soon as more returns from their use are available, it 
will be possible to tell the degree of skill in each test 
which the average child in any particular grade should 
attain. 

It is to be remembered that the Courtis Tests are 
"neither lesson sheets nor examination papers." They 
are only methods of investigation — mere measurmg rods. 
By their use are revealed the actual arithmetical condi- 
tions existing in schools, classes, and individuals. To 
find the causes of any unsatisfactory conditions which 
the tests may reveal, and to remove these causes, is an- 
other problem. 

The repeated use of these scales will tend to reveal the 
laws of development as they operate in the classroom, 
and to measure the efficiency of any particular educational 
method. A class which is being taught division by a 
certain method may be tested at intervals to see what 
improvement is taking place. If little or no improvement 
is shown, it may be safely inferred that the method used 
is not suited to that particular group ; and new methods 
of instruction may be devised and tested, until the im- 
provement is so marked as to leave little doubt that 
the method finally adopted is the one which produces the 
best results with the group in question. In short, the 
tests of Series E are scientific measures of efEciency in four 
operations of arithmetic, which may be used to determine 
the best methods of teaching these operations. Smce 
the same tests, or their equivalents, are used in all the 
grades, a child or group of children may be measured 
over and over again, and the progress determined by the 
changes in the score, just as height is measured over and 
over again with the same measuring rod. 

Since the use of standard tests makes objective scoring 
possible, any teacher can easily establish objective stand- 
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ards of work for a class; and in time it will be known 
what the actual standards for different school systems 
are. To facilitate this work of standardization, Comtis 
has published printed folders of instruction covering every 
phase of the testing, such as scoring, tabulating results, 
the making of graphs, etc. Very likely Series B will 
eventually displace Series A, except for the solution of 
special problems, and standards of permanent value will 
be obtained from its use. To those who wish to give a 
single test, merely to see the nature of the experiment or 
to measure the general character of the arithmetical work 
of a class as compared with that done in another class or 
school, the test on fimdamentals (Test No. 7) in Series A 
is recommended, for it is a general measure of the ability 
to add, subtract, multiply and divide with whole 
numbers. 

The administration of these tests is an easy matter. 
The twelve tests — the eight of Series A and the four of 
Series B — are printed on separate sheets of paper, each 
containing complete directions for its use. It is advisable 
to procure with these test sheets the manual containing 
full directions for the giving of the tests ; for the essence 
of this movement lies in uniformity of administration 
and marking. The Courtis Standard Tests for Arith- 
metic may be obtained at the Department of Cooperative 
Research, 82 Eliot Street, Detroit, Michigan. 

If a teacher desires merely to compare the general char- 
acter of the work of a class with the work of other classes 
of the same grade, all that is necessary is to send for 
Test No. 7, Series A, together with the folder relating to 
the tests of that series. If, after the administration of this 
single test, more specific information is desired regarding 
the work of pupils m the various sub-branches— addition, 
subtraction, etc. — other tests in Series A, Test No. 1, 
for addition. Test No. 2, for subtraction, and so on, may 
be procured and administered. In the fourth grade and 
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above it is advisable to use the tests of Series B, as they 
are cheaper and require less time to administer. 

The actual application of the test is very simple and 
requires but little time — from one to twelve minutes 
according to the test. For example, in giving Test No. 1, 
Series A (Addition), the teacher, after reading the instruc- 
tions for administering the test as given in the manual 
for Series A, will proceed somewhat as follows. Holding 
up one of the test sheets before the pupils, the teacher 
will give directions for fillmg out the blank spaces at the 
top of the paper with the name of pupil, the grade, and 
name of school. Then, in a manner calculated to secure 
cooperation, the pupils will be told just what is expected 
of them; namely, at a given signal, "Start," to add 
across the paper from left to right, putting down the 
answers in the spaces allowed between the lines until 
the signal, "Stop," is given. This signal is given after 
one minute's time has elapsed. The teacher later records 
the number of problems each child has done correctly. 
This constitutes his score. A more or less similar course 
Is followed with each of the other tests. 

The only warning to be observed in the administration 
of the tests is that care must be taken to see that all the 
pupils start and stop at the same time, and that every 
effort be made to secure the interest and cooperation of 
the children. The work itself should proceed smoothly 
and steadily with no hurry or excitement. Class averages 
may be obtained from the record of the individual scores 
and such averages may be compared with those obtained 
from different parts of the country. (See Standard 
Scores.) 

Within the classroom the teacher is in a position to 
determine which children should be selected for special 
attention. For example, if a child's record shows him 
to be very high in multiplication and low in addition, 
efforts should be made to improve the latter, and he 
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should not be made to waste time on multiplication drills. 
Tests administered at the beginning of school in Septem- 
ber will show what children fall below the standard for 
each process in that grade. Several tests during the 
year will show the efficiency or inefficiency of the methods 
used to bring these children's records up to standard. 
Furthermore, a child's improvement may be followed 
from grade to grade by keeping a record of each pupil's 
score. The results obtained from the administration of 
such tests also make possible the accurate comparison 
of school systems and classes. These tests mean better 
work on the part of teachers because they reveal just 
what they are accomplishing; they mean progressive 
educational changes brought about through those methods 
of instruction which have produced the best results. 



As 



STANDARD SCORES 
L result of administering the eight tests in Series A 



to almost 6700 pupils throughout the United States, 
Courtis has worked out the following tentative standard 
scores. These, it should be noted, are the average scores 
actually obtained by the pupils themselves. 







J 


2 


3;* 4 


J 


N».e 


No. 7 


No. 8 


T«t No. 


Atl«, 


»- 


Att«, 


BU. 


Att,. 


Rt.1 


Grade ni . 
Grade IV . 
Grade V . 
Grade VI . 
Grade VII . 
Grade VIII 
Grade IX . 




2G 

34 
42 
50 
53 
63 
66 


19 

25 
31 

38 
44 
49 
60 


16 

30 

37 
44 
49 
60 


5S 
72 
86 
99 
110 
117 
120 


2.7 
3.7 
4.8 
5.8 
6.8 
7.8 
8.6 


2.1 

3.0 
4.0 
5.0 
6.0 
7.0 
7.8 


5.0 
7.0 
9.0 
11.0 
13.0 
14.0 
15.0 


2.7 
3.3 
4.9 
6.6 
8.3 
10.0 
II.O 


S.0 

2.6 
3.1 
3.7 
4.2 
4.8 
5.0 


1.1 

1.7 
2.2 
2.8 
3.4 
4.0 
4.3 


minutes . . . 


1 


1 


1 


1 


6 


6 


12 


n_ 


6 


6 



Thus in the Addition Test (Test No. 1), the average 
score in Grade V is 42, the number of correct additions 
made in one minute. Similarly, for all the other tests. 

n. WOODY ARITHMETIC SCALE i 
Whereas, in each of the separate Courtis Tests the 
problems are of approximately the same difficulty through- 
out, in the Woody Scales a different method of measuring 
efficiency is employed. The scales are designed to measure 
work in the four fundamental operations of (a) addition, 
(6) subtraction, (c) multiplication, and (d) division, re- 
spectively. Each of these scales consists of a great variety 
of problems falling within the field of the particular opera- 
tion that the scale is designed to test. These problems, 
beginning with the easiest that can be found, gradually 
increase in difficulty until the last ones in each scale are 
so difficult that only a relatively small percentage of the 
pupils in the eighth grade are able to solve them correctly. 
That is, taking the addition scale for example, the problems 
rise in difficulty from the first, which requires next to no 
ability in addition, up to the last, which, though still an 
addition problem, is of sufficient complexity to test chil- 
dren of the eighth grade. The relative difficulties of the 
problems within each scale were determined by adminis- 
tering them to large groups of children in several school 
systems, the difficulty of a problem being calculated 
from the percentage of correct answers by a method 
similar to that used in the Buckingham Spelling Scale. 

Two distinct series of scales in each of the above named 
operations have been devised. It will be sufficient here to 
describe the shorter of these scales. Series B, and to illus- 
trate the general principles which underlie this method of 
measurement. For the other scale with a full account of 
its instructions, method of administration, scoring, etc., 
' the reader is referred to the original study. 

' The Bcalea are reproduced by the courtesy of Dr. Clifiord Woody. 
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Series B — Addition Scale 

Name 

When is your next birthday? How old will you be? . . . 

Are you a boy or girl? In what grade are you? 



(1) (2) (3) (5) (7) (10) 

2 2 17 72 8 + 1 « 21 

3 4 2 26 83 
— 3 — — 86 



(13) (14) (16) (19) (20) 

23 25 + 42 » 9 $.75 $12.50 

25 24 1.25 16.75 

16 12 .49 15.76 

— 15 

19 



(21) 




(22) 


$8.00 




547 


5.75 




197 


2.33 




685 


4.16 




678 


.94 




456 


6.32 




393 
525 
240 
152 


(33) 




(36) 


.49 


2 


yr. 5 mo. 


.28 


3 


yr. 6 mo. 


.63 


4 


yr. 9 mo. 


.95 


5 


yr. 2 mo. 


1.69 


6 


yr. 7 mo. 


.22 
.33 










.36 






1.01 






.56 






.88 






.75 






.56 






1.10 






.18 






.56 







(23) (24) (30) 

J + J = 4.0125 2J 

1.5907 6i 

4.10 3} 

8.673 — 



(38) 
25.091 + 100.4 + 25 + 98.28 + 19.3614 = 
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Series B — Subtraction Scale 

Name 

When is your next birthday? How old will you be? 

Are you a boy or girl? In what grade are you? 

(7) 

13 

8 

(17j 
393 
178 

(25) 

27 

12f 

(35) 
8i - If - 



Series B — Multiplication Scale 

Name 

When is your next birthday? How old will you be? 

Are you a boy or girl? In what grade are you? 



'1' 

5 




1 




(6) 
11 

7 


(9) 
78 
87 


\ 


(13) 

16 

9 




(14) 
60 
26 


(19) 
567482 
106493 


4 in. 
8 in. 


(20) 
2i-l- 

7.8 - 


(31) 
3.00081 


(24) 
8J 
6i 


(27) 
5 yds. 1 ft. 
2 yds. 2 ft. 


- 



(1) (3) (4) (5) 

8X7- 2X8- 4X8= 23 

3 



8) (?) (11) (12) 

2H 1036 5096 

8 6 8 6 



(18) (16) (18) (20) 

8754 7898 24 287 

8 234 .06 

(24) (26) (27) (29) 

16 9742 6.25 i X 2 - 

2f 69 3.2 

(33) (35) (87) (38) 

2i X 8i « 9871 2i X 4i X li « .0963) 

26 .084 
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Series B — Division Scale 

Name 

When is your next birthday? How old will you be? 

Are you a boy or girl? In what grade are you? 



(1) 

8JS 


(2) 
9)27 


(7) 
4^2 = 


(8) 
9J0 


(11) 
2)13 


(14) 
8)6866 


(16) 

i of 128 => 


(17) 

60 +7 - 


(19) 

248 -3-7 - 


(23) 
23)46d 


(27) 

i of 624 - 


(28) 
.003).0d36 


(30) 


(34) 
62.60 


■s-U- 


(36) 

9)69 lbs. 9 oz. 



Series B was especially constructed for use in the 
measurement of arithmetical ability when the amount 
of time for such measurement is limited. The break 
in continuity in the numbering of the problems does not 
mean that the whole scale is not presented. The scale 
is quite complete as it stands ; the nimibering is a matter 
of convenience for purposes external to the use of the scale. 

The Addition and Subtraction Scales can be used in 
Grades II to VIII inclusive; the Multiplication and 
Division Scales, in Grades III to VIII inclusive. It is 
recommended that in the use of Series B all tests be given 
together. 

DIRECTIONS FOR ADMINISTRATION 

It is very necessary that the same standard method be 
employed in the giving of these tests; care should be 
taken that the same directions are given in the same way 
to all groups taking the tests. The following are the 
general directions which should be carefully followed: 
Distribute the papers face down and do not allow the 
pupils to turn them over until they are told to do so. 
When all are ready with pencils in hand, say: "Turn 
your papers over and answer the questions at the top 
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of the page." When all these preliminary questions 
have been answered, repeat the following formula of 
specific directions. If you are giving the Addition test, 
say, " Every problem on the sheet which I have given 
you is an addition problem, an ' and problem.' Worii as 
many of these problems as you can and be sure that you 
get them right. Do all your work on this sheet of paper 
and don't ask anybody any questions. Begin." 

For each test in Series B allow ten minutes. It is 
essential that all the pupils start and stop work together 
because the test is partly one of speed. Most of the 
children will have finished all that are within range of 
their ability before the end of the time allowed ; those 
who have not must not be allowed any further time. 

The only variation in procedure in giving any of the 
other tests is the substitution in the formula of specific 
directions of the expressions "subtraction or 'take away 
problems,'" "multiplication or 'times problems,'" and 
" division or ' into problems,'" for the expression " addi- 
tion or 'and problems.'" Since teachers in the lower 
grades sometimes use the expressions " and," " take away," 
"times," and " into," problems, these forms should also 
be used in administering the test so as to make clear to 
the children what is expected of them. 

DIRECTIONS FOR SCORING THE TESTS 

In scoring each test the standard of marking should be 
absolute accuracy and the final answer should be in its 
lowest terms. 

If the results of class measurement are to be compared 
with the results and values established by the author, 
only those answers should be accepted as correct which 
are identical with those given in the following table, since 
these are the solutions upon the basis of which the original 
scoring was done. 
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Answers to Problems. Series B 



Addition 


SUBTBAOnON 


Problem 


Answer 


Problem 


Answer 


1 

2 

8 

5 

7 

10 

13 

14 

16 

19 

20 

21 

22 

23 

24 

80 

83 

86 

88 


5 

9 

19 

98 

4 

89 

64 

67 

79 

$2.49 

$45.00 

$27.50 

3,873 

18.3762 

12} not 11 V = 

10.55 
22 yrs. 5 mo. or 

22A yrs. 
268.1324 


1 . . 
3 . , 

6 . . 

7 . . 
9 . . 

13 . . 

14 . . 
17 . , 

19 . , 

20 . . 

24 . , 

25 . . 
27 . , 

31 . . 
35 . . 






3 

1 

4 

5 

41 

7 

25 

215 

460,989 

1 
3 
14 
2 yds. 1 ft. 8 in. 

not 81in. 
4.29919 
2i not 2} » i 



MULTIPLIOATION 


Division 


Problem 


AjiBwer 


Problem 


Answer 


1 

3 

4 

6 

8 

9 

11 

12 

13 

16 

18 

20 

24 

26 

27 

29 

83 

35 

Om II • • • • 

88 


21 

6 

32 

69 

150 

1,524 

8,288 

30,576 

70,032 

71,082 

5,616 

14.35 

42 

674,778 

20,000 

i not} 

24693} 

.0080902^ or 


1 . , 

2 . , 

7 . . 

8 . . 
11 . . 

14 . . 

15 . . 
17 . . 
19 . , 
23 . . 

27 . , 

28 . . 
30 . . 
34 . . 
36 . . 






2 
3 
2 


6} not 6 + 1 
732 

32 

7f not 7 + 1 
35f not 35+3 
20^; 20.3, not 

20+9 
546 
31.2 

v •'' 

71 lbs. 11} oz.; 
71 lbs. 9 oz. 




.00809026 











Arithmetic Scales 



27 



, METHOD OF DETERMINING THE CLASS ACHIEVEMENT 
The method used for determining the class achieve- 
L ment with Scale B is simpler than that employed in the 
I use of Scale A. It is largely for this reason that Scale B 
E was chosen for description. It should be noted that in 
' each of the scales a definite attempt has been made to 
place the problems so that they would increase by uni- 
form stages of difiiculty from the first to the last. Thus, 
in the Addition Scale problem 3 is as much more difficult 
than problem 2 as problem 5 is more difficult than problem 
3, and so on. If one compares this with the method of 
the Courtis Tests, it will be seen that in the latter the 
problems involving a given operation are all of approxi- 
mately the same difficulty and require precisely the same 
knowledge and method for their solution. In other words 
the Courtis Tests measure speed in the various operations 
in arithmetic rather than extent of knowledge of the 
operation involved. In the Woody Scale, because the 
problems increase in difficulty, the score measures a 
certain extent of knowledge of the process involved in 
the operation rather than mere speed of performance. 
For example, in a race one could have a series of hurdles 
of all the same height and test the number cleared in a 
certain time — such is the Courtis method ; or the 
hurdles could get gradually higher and higher, the success of 
the individual being measured by the hurdles he can clear 
without a fall — such is the method of the Woody Scales. 
An objection is sometimes made by teachers that the 
problems are too hard for the children. In this con- 
nection it cannot be pointed out too clearly that when 
scales of this type are used in the schools it is not ex- 
pected that the children will be able to do all the prob- 
lems, just as when we determine the height of a child by 
means of an eight-foot rule, we do not expect the child 
to measure up to the eight feet. 
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The achievement of a class is measured by calculating 
the median number of problems which were solved cor- 
rectly. By the median number is meant that number 
which marks the point at which there are just as many 
pupils who solve a greater number correctly as there are 
those who solve a less number correctly. In order to 
measure the median point of achievement of the class, 
it is necessary to make a distribution table, showing the 
number of pupils who were unable to solve a single prob- 
lem correctly, the number who solved one, two, three, 
etc., up to the final number. Take the following as an 



Number op Times a Gives Number of Addition Problems Was 
Solved Correctly 




0ll|2 


; 


4 



5 

4 


6,7 8 910 
1{2J35 6 


11 


12 


13 


14 
"2 


15 

1 


16 
1 


17 
1 


18 


No. of pupils .... 


# 


11 


1 


6 





That is, one pupil failed to solve a single problem. With 
that exception there were no children who did not solve 
at least one problem correctly. Two children solved 
two problems correctly, three children solved three 
problems correctly, four solved five correctly, and so on. 
Since there are, let us say, 52 individuals in a given 
class, "the median point evidently falls between the 
achievements of the 26th and 27th pupils. Let us begin 
with the individual who was unable to solve a single 
problem correctly and count the two individuals who 
solved two problems, the three who solved three prob- 
lems, and so on until we come to the step that includes 
the 26th individual. Now if we are to indicate the exact 
point in the achievement of the pupils where there are 
just as many pupils who solve a greater number of prob- 
lems as there are those who solve a less number, it is 
necessary to count 5 of the 6 individuals who solved 10 
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^problems correctly. Thus, on the assumption that the 
I individuals are distributed over any step at equal dis- 
I tances from one another, the median point is § of the 
I distance through this step. Hence, the median achieve- 
l ment of this class, i.e. the median number of problems 
I solved, is 10.8 problems correctly solved." 

TENTATIVE STANDARDS OF ACHIEVEMENT 
The following standards of achievement have been 
determined on the basis of tests made on several thousand 
children from the second to the eighth grades of various 
school systems. It is possible that with further experi- 
mentation they may need to be slightly altered. 

Tentative Standard op Achievement for Series B 



[ G«^. 


A..™« 


SOBTBACnOH 


MULTIPLICA- 


p™.« 


II ... . 


4.5 


3 






Ill . 














IV . 






11 


8 


7 


6 


V . 






14 


10 


n 


7 


VI . 






16 


12 


15 


10 


vn . 






18 


13 


17 


13 


VIII . 






18.5 


14.5 


18 


14 



The standards are based upon the total number of 
problems that were correctly solved in each grade. Thus 
in the second grade in addition, the median achievement 
was 4.5 problems, in the third grade, 9.0 problems, etc. 

All that is necessary, therefore, to test a class is to 
procure the standard blanks, follow the detailed instruc- 
tions in administration and scoring, and then determine 
the median score by the method shown. This median 
score can then be compared with the tentative scores 
given by the author. It should be noted of course that 
these tentative scores would cease to have significance if, 
previous to the test, the children had been drilled on ex- 
amples framed with the particular scale problems in mind. 
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EXERCISES 

1. How does the general character of the work of your dass, as 
revealed by the administration of Test No. 7, Series A, compare with 
that of other classes of the same grade in your building or dty? 

2. How does the work of your pupils in the various sub-branches, 
as revealed by the tests, compare with the standard scores for your 
grade? How does it compare with the work in these sub-branches 
in other classes and schools where you may be able to test? 

3. Suppose the frequent administration of the tests failed to re- 
veal a reasonable amount of improvement in the various sub-branches, 
what would this seem to indicate? 

4. Could the tests be utilized to remedy this condition? 

6. What two important facts in regard to the ability of the pupils 
in your dass have the tests revealed? 

6. Suppose the tests showed the ability of a pupil to differ greatly 
in the various sub-branches, what action should the teacher take in 
regard to it? 

7. For what purposes may the Woody Scale be used to greater 
advantage than the Courtis Scale ? 

8. In your experience with the tests, have they tended to show 
any relation between ability in one branch and ability in another? 

9. What precautions should be taken in administering the tests? 
10. In what ways should the continued use of these tests increase 

the effidency of a teacher of arithmetic? 




Probably there is no subject about which opinions of 
efficiency are more vaguely expressed than the subject of 
handwriting. Such terms as "good," "fair," "poor," 
etc., merely express the individual teacher's judgment aa 
determined by certain factors, such as legibility, grace, 
character, etc., or by certain styles, such as vertical or 
slanting, to which that individual is partial. No two 
teachers mean the same quality by the use of the same 
term. Consequently such judgments, because they are 
not expressed in terms of a universal standard which 
conveys the same meaning to everybody, are of little 
value when comparisons are necessary. Within recent 
years attempts have been made to eliminate this unscien- 
tific type of judgment, which is the natural result of the 
lack of a standard, by the construction of a scale for 
measuring the quality of handwriting. Thomdike and 
Ayres have each devised such a scale or standard, while 
Courtis has outlined a method by which it is possible to 
obtain samples of children's handwriting, made under 
uniform conditions. Each of these methods will be de- 
scribed briefly in tiUTi. 
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I. THORNDIKE HANDWRITING SCALES 
Thomdike was the first to construct an objective scale 
for handwriting. This appeared March, 1910, and was 
developed as follows. One thousand samples of hand- 
writing, ranging from the worst to the best to be found 
in the sixth, seventh, and eighth grades, were given in turn 
to forty competent judges. Each of these judges was 
asked to rank these samples according to their "general 
merit," which was to be based on a combination of grace 
and legibility, by placing each specimen in one of eleven 
arbitrary groups in order of increasing merit. Previous 
experiments had shown that these samples, instead of 
falling into a thousand different classes, naturally fell into 
about eleven groups, all the members of a group being of 
about equal merit. That is, the same thing is true of 
handwriting as is true of attempting to divide into a 
thousand classes a thousand people whose height varies 
from five to six feet. Many would be so nearly of the 
same height as to make such a classification impracticable, 
if not impossible. Similarly, exact classification would 
be impossible in the case of writing, where the distinction 
between the samples was not pronounced. 

After each judge had placed each sample three or four 
times in this way in one of these eleven groups, the aver- 
age result of his rankings was taken as his final grading 
for each specimen; that is, if a judge ranked a certain 
specimen of handwriting in class 10 on the first occasion, 
in class 11 on the second, in class 12 on the third and in 
class 10 on the fourth, on the whole he placed it some- 
where between classes 10 and 11, or to be exact, at a 
point which can be represented by 10.7. Then the re- 
turns of all the judges were massed and the average of all 
rankings given to each sample was determined. In this 
way the place assigned to each specimen by the com- 
bined opinion of all the judges was fixed. When the 
averaged judgments were collected (as might be expected 
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■ where so many samples were concerned), it was found 
that some samples were placed in, or approximately in, 
each of the eleven groups ; that is, some samples were 
graded 1, 2, 3, 4 . . . 11, while many samples were given 
ranking midway between the different groups, indicated 
by the markings 1.4, 1.6, 2.1, 2.8, etc. 

Now when it is recalled that each one of these groups, 
in the opinion of the judges, is separated from the others 
by equal steps of merit, it may readily be seen how a 
handwriting scale can be obtained, provided only that 
samples be graded exactly or approximately as falling 
into groups 1, 2, 3, 4, . . . 11, the handwriting samples in 
group 2 being as much superior to those in group 1 as 
those in group 3 are superior to those in group 2, etc. 
In this way the Thomdike Scale was obtained, a scale 
whose steps of difference forty competent judges have 
considered to be equal. Later, this scale was extended to 
include fifteen classes of handwriting which ranged in 
quality from handwriting which may barely be called 
such to that suitable for decorative purposes. 

This scale with its various classes of handwriting has 
from one to three different styles of writing in each group. 
Undoubtedly it would be far more satisfactory if each 
class contained samples of all the various types of writing 
which are found in the school. This defect, however, 
can easily be remedied when a larger number and greater 
variety of samples become available. Furthermore, it is 
to be regretted that this scale, which measures about 
twenty-two by twenty-four Inches, is not issued in more 
convenient form. 

In spite of these slight defects, which time will remedy, 
the scale is certainly far superior to the judgment of any 
one individual. The method of using it is very simple. 
A sample of handwriting is measured by placing it along- 
side the scale and estimating to which one of the fifteen 
groups, as represented by the fifteen samples, it belongs. 



If it is thought to lie between two groups, a fraction may 
be added or subtracted according to whether it is judged 
better or worse than the sample on the scale to which 
it most nearly corresponds. Thus, if it falls between 
classes 12 and 13, it might be graded at any point in 
between, such as 12.4 or 12.8. For especially accurate 
work, it is well to have several individuals rank the 
samples of handwriting and then take the average of 
their rankings as the final measurement. Care should be 
taken to decide a specimen's grade not because of its like- 
ness in style to some sample in the scale, but because of its 
likeness in quality. 

After the person gradmg has become familiar with the 
scale, comparisons will be facilitated if the scale is folded 
so that the samples form the pages of a book. Then the 
judge should pass rapidly from the lowest to the highest 
sample, rating the specimen by his impression as a whole, 
inasmuch as such an impression is the resultant effect of 
all the qualities possessed by the writing. Long, pains- 
taking comparisons prevent accuracy instead of securing 
it. When it is necessary to compare a specimen with 
samples unlike it in slant and character, placing it some- 
where between two groups will often solve the difficulty. 



n. ATRES HAHDWRirmG SCALE' 

The Thomdike Scale is based on general merit of hand- 
writing. The Ayres Scale, on the other hand, is based on 
legibility; thus there is a substitution of function, instead 
of appearance, as a criterion. Ayres takes this standard 
for two reasons. In the first place, the purpose of writing 
is to be read; hence "readability," or legibility, is the 
prime requisite. In the second place, it is exceedingly 
easy to measure the legibility of any sample of hand- 
writing by determining the time it takes to read it. In this 
' For reproduction of Ayres Scale, see pages 60 to 67. 



J an exact evaluation of the relative legibility of any 
" specimens may be obtained in terms of a unit of time. 
The criterion of general merit, though based on the opinion 
of competent judges, does not allow of this accuracy. 

The method by which this scale was produced differs 
radically from that used by Thomdike, Previous experi- 
ments had shown that the best way to find out the rela- 
tive legibility of different samples of handwriting was to 
find out the rate, in words per minute, at which each 
sample could be read. In order to represent a random 
selection and not the writing of any particular city or 
section, 1578 samples were secured of the handwriting of 
children in the upper elementary grades of 40 school 
systems in 38 different states. These samples did not 
consist of words so arranged as to convey a meaning, but 
were composed of words thrown out of context. The 
object of this was to make it necessary for the reader to 
decipher each word separately, and to make it impossible 
for him to memorize. Through the cooperation of super- 
intendents and teachers, samples from either the best or 
the worst class in any city were avoided, and it was so 
arranged that the pupils made no effort to write with 
exceptional care or rapidity. 

These 1578 samples were then turned over to ten com- 
petent paid assistants, who in turn read each sample and 
by means of a stop watch recorded the exact time it took 
to read it. After each sample had been read by the ten 
readers, the average time taken to read it was computed. 
Then the rate in words per minute at which the reading 
had been accomplished, was found by dividing the average 
time it took to read a given sample by the number of 
words in it. This process was repeated for each one of 
the 1578 samples. After it had been determined to what 
extent the readers had increased their reading speed 
through practice, the firet 75 papers were reread and new 
times recorded to correct this error. 
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The next step was the elassifieation of these samples. 
After various attempts at this, five classes — vertical, 
medium slant, extreme slant, backhand, and mixed — - 
were finally carefully defined on the basis of the arbitrary 
judgment of a number of competent judges. Then each 
of the samples was classified on the basis of the slant of 
its letters and assigned to one of these five classes. Be- 
cause of the limited number of backhand and mixed 
samples of handwriting, these were left out of the final 
scale. 

The scale itself was then constructed in the following 
manner. All of the samples, which had been so marked 
as to indicate both the rate at which each one had been 
read and the class or style of writing — vertical or slant, 
etc, — to which it belonged, were arranged in one long 
series beginning with the sample having the lowest time 
rating and extending to the one having the highest. As 
might be expected, there were many samples of medium 
grade — that is, that were read at a medium rate ; only 
a few that were very good — read at a rapid rate ; and 
only a few that were poor — read at a very slow rate. 
Then, beginning at the poorest sample — that which took 
the longest time to read — a count was made just halfway 
through the samples. The specimen thus obtained was 
the central point, below which one half of the samples 
were read more slowly, and above which, one half were 
read more rapidly. This sample had been marked 175,7 
indicating that it was read at the rate of 175.7 words per 
minute. Because of its central position, considering the 
entire series as 100, this sample was called 50, In a suni- 
lar manner samples were picked out one tenth, two tenths, 
three tenths, four tenths, six tenths, seven tenths, eight 
tenths, and nine tenths of the way through the series, 
and these were designated 10, 20, 30, 40, 60, 70, 80 and 
90, respectively. These values were chosen because 
teachers are familiar with them in grading. 
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The rate of reading marked on these samples was 
' found to be 130.2, 149.4, 163.5, 175.7, 186.1, 195.8, 202.9, 
and 209.6 words per minute, respectively. Thus it was 
seen that this scale does not proceed by equal steps as far 
as the time consumed in reading is concerned. Instead, 
the gain in time rate became progressively smaller as one 
moved from the worst to the best sample. How reasonable 
this is, may easily be seen. A very poor handwriting takes 
a long time to decipher. One which is just slightly better 
may be read almost twice as fast. A still better one may 
be read somewhat faster but not twice as fast as the pre- 
vious one, and so on, the gain in the rate growing smaller 
and smaller as the handwriting improves. Thus, as far 
as readability is concerned, the difference in the time it 
takes to read a sample marked 30 and one marked 40 is 
greater than the difference in the time it takes to read 
one marked 60 and one marked 70. So, what is actually 
meant when it is said that the steps of this scale are equal, 
is that each one of them has been so chosen that it is as 
much better than the one before, as that one is better 
than the preceding one. Qualities 60 and 40 are respec- 
tively equally distant above and below quality 50 ; that 
ia, there is the same proportion of samples between 50 and 
60 as between 40 and 50, and so on down the scale. 

The scale itself is on a sheet of paper measuring nine by 
thirty-six inches. It contains eight groups {the lowest 
and the highest groups being omitted in the final scale), 
each group including three types of handwriting, the 
vertical, the slant, and the extreme slant. Ayres' studies 
have shown that 95% of the common writings of school 
children are included in these three styles. To facilitate 
comparison, both the paper and the ink used in the scale 
are of the color used in the public schools. The scale is 
used in exactly the same way as the Thomdike Scale. 
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m. COURTIS HAHDWRITIHG TESTS 
It is apparent that the efficient use of such objective 
scales necessitates imposing uniform conditions when 
obtaining the handwriting samples to be measured. 
That is, it would be unfair to grade by the same stand- 
ard a sample of handwriting written at a very rapid rate 
of speed, and one written at a very slow rate of speed. 
The time allowed in the writing of the samples should be 
the same. Courtis has attempted to overcome this diffi- 
culty by the use of a simple method whereby samples 
may be obtained of a pupil's handwriting under formal 
conditions {at a fixed rate of speed), and under casual 
conditions (at the writer's natural rate of speed). Samples 
written under either one of these conditions, providing 
all the samples were obtained under the same circum- 
stances, may then be graded by either the Thomdike or 
the Ayres scale. 

The value of such scales as have been described is very 
great. In the first place, they represent measures that 
are the outcome of the thought, labor, and experiment of 
many persons and as such they are far superior to the 
casual and oftentimes thoughtless opinion of any one 
individual. Not only may such scales measure the rela- 
tive quality of different samples of handwriting or the 
improvement in handwriting in an individual, but by 
means of them entire classes, groups, and systems, whether 
chosen for grade, age, sex, method of teaching, length of 
practice drills, etc., may be compared ; for the scale con- 
stitutes the basis of judgment wherever it is used. So it 
makes no difference whether a sample is called X, A, 
100, or any arbitrary name, provided it represents in 
terms of the scale the same quality to every person. By 
means of these scales teachers may determine the progress 
and needs of their pupils as well as the efficiency of the 
methods they are using. Supervision may also be made 




more effective because school officials, given the actual 
results of such tests, are provided with the means for 
making a scientific analysis of school conditions. How- 
ever, as Thomdike says, such scales will do their greatest 
service not as measuring rules, but "by creating in the 
minds of teachers a mental standard to be used in even 
the most casual ratings of everyday school life." 

STANDARD SCORES 

It is obvious that if the above scales are used in meas- 
uiing the writing ability of a sufficient number of chil- 
dren, standard scores of efficiency for each grade may be 
computed by finding the arithmetical average of the 
records obtained in each grade. That is, on the basis of 
the results obtained from the use of the scales, it is pos- 
sible to say just how fast and how well pupils in any one 
grade should write. 

Starch secured tentative standard scores of this kind 
by administering the Thomdike Test at the end of the 
school year to about 4000 pupils in eight cities of three 
states, and finding (1) the average rate of speed and (2) the 
average quality of writing, in each one of the grades. 
Starch's results were as follows : 

Grades 12 3 4 56 7 8 

Speed (letters per minute) 20 31 38 47 57 65 75 83 
Quality (Thomdike Scale) 6.5 7.5 8.2 8.7 9.3 9.8 10.4 10.9 

According to these scores we find that the average 
child in the second grade, for instance, writes at a speed 
of 31 words per minute and possesses a quality of hand- 
writing indicated by 7.5 on the Thomdike Scale or, by 
derivation, 26.5 on the Ayres Scale. 

The Thomdike Scale was chosen in preference to the 
Ayres Scale because the latter does not extend so far at 
the lower and upper limits as the former; that is, the 
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limits of the Ayres Scale lie within quaUties 7 to 14 of the 
Thomdike Scale, However, equivalent values for quaU- 
ties in the Ayres Scale have been derived ; that is, one 
step on the Thorndike Scale has been found to be equal 
to 8.9 points on the Ayres Scale. So the standard scores 
may be expressed in units of either scale. As a result of 
this derivation we have the following equivalents : 
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In obtaining these standards it was apparent (1) that 

writing in the various grades differed widely in regard to 
both speed and quality ; and (2) that the abilities of the 
pupils in one grade in many instances overlapped the abil- 
ities of the pupils in the adjacent grades. For instance, the 
handwriting of pupils in the first grades in three schools 
in city A was found to range all the way from quality 4 
to quality 10.5, and that of pupils in the eighth grade, 
from quality 5 to quality 15. So great was the over- 
lapping that the averages of the various grades differed 
from each other by only small amounts. 

To recapitulate, the first thing to be done by a teacher 
who is desirous of measuring the handwriting of pupils, 
is to see that the samples to be measured are all obtained 
under the same conditions. This may be done by having 
the pupils write at their natural rate of speed a selection, 
or part of a selection, with which they are all familiar. 
Care should be taken to see that they all start writing at 
the same time and stop at the same time, say at the end 
of two minutes. 



The speed of writing for each pupil may be easily deter- 
mined, in terras of letters per minute, by dividing the total 
number of letters written by two. The average speed of 
writing for the class may then be computed and com- 
pared with the standard score for that grade as given by 
Starch. 

The samples may then be measured for their quality 
by either the Thomdike or the Ayres Scale. The former 
may be secured by sending to Teachers College, Colimibia 
University, New York ; and the latter, by sending to the 
Russell Sage Foundation, Department of Education, New 
York. 

In determining the quality of any given specimen of 
handwriting, all that is necessary is to slide the specimen 
along the scale beginning with the poorest sample until 
a writing of corresponding quality is found. If this 
writing is marked, say 11 in the Thomdike Scale, then 
that is the value of the handwriting measured. If the 
quality of the specimen seems to be better than quality 
11, but not so good as quality 12, then it should be given 
a value somewhere between 11 and 12, say 11,2 or 11.8, 
according to whether it is judged better or worse than the 
sample on the scale to which it most closely corresponds. 

It is advisable for the teacher to have one of the scales 
on the wall, in order that it may be utilized by the pupils 
themselves. 

It is obvious that in comparing the handwriting of any 
two classes of the same grade the following conditions 
must have been fulfilled; (1) All of the children must 
have written the same selection for their samples ; (2) all 
must have had the same degree of familiarity with the 
selection; (3) all must have been allowed the same time 
in which to write ; (4) all the results must be expressed in 
terms of the same scale. Such uniform conditions may 
be realized within any given school system through a 
set of specific instructions sent out by the supervisor of 



writing or the superintendent of instruction some days 
before the measurements are to be made. 



EXERCISES 

1. Take thirty epecimens of writing distributed through the 
gradea and have these marked by five teachers according to their 
usual percentage methods. How do the results agree? 

2. Repeat the above experiment with the exception that the 
grading is done by means of tbe Thomdilie Scale. How do the esti- 
mates of the five teachers compare now? 

3. Suppose a teacher found as a result of using the scale that the 
pupils were above the average (standard score) for that grade in 
speed of writing but below the average in quality, or vice versa, what 
should be done 1 

i. Does there seem to be any relation between speed and quality 
of handwriting? 

5. Is there any practical lesson to be learned from the fact that, 
although a group of children may be made to write in the same way 
up to 14 years of age, at 18 each has his own particular style? 

6. What would be the result of getting the children to grade 
their own handwriting and to compare their results? 

7. Suppose a teacher found a great difference in the quality of 
the handwriting of the pupils in a given grade, some pupils writing 
far above the average for that grade and others far below it. what 
should be done? 

8. What is the best thing to do it a teacher finds it necessary to 
compare a given specimen of handwriting with samples in the scale 
which are unlike it in slant or character, or both? 

9. How may the scale be used to test the efficiency of any method 
of teaching handwriting? 

10. What factors should a teacher take into consideration when 
Betting a standard of handwriting tor a given c 
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CHAPTER IV 

READmG SCALES 

I. THORNDKE AND GRAY SCALES 
n. STARCH SCALE 
m. COORTIS SCALE 

Since it is through reading that a large part of our in- 
formation is obtained, an objective means of measuring 
efficiency in that subject is of great importance. Several 
attempts have been made to fill this need. In 1914 
Thomdikeand Gray published tentative scales for measur- 
ing school achievement in reading, and later both Starch 

id Courtis published tests for the same purpose. 



L THORNDKE AND GRAY SCALES 
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In Thomdike and Gray's Scales attempts are made to 
measure the following factors : " (1) silent reading so far 
as it concerns {a) the imderstanding of words singly and 
(6) the understanding of sentences and paragraphs ; and 
(2) simple, oral reading of matter-of-fact passages." 
Each of these three scales will be described in turn. 

(i) Scale A for Visual Vocabulary 
The scale designed to measure a pupil's knowledge of 
the meaning of single words is called "Scale A or the 
Scale for Extent or Range of Visual Vocabulary." It is ' 
printed on a single sheet of paper and consists of nine 
lines of words. These lines are numbered 4, 5, 6, 7, 8, 
9, 10, 10,5 and 11 respectively. All the words on the 
same line are about equally hard to understand, and their 
iculty increases gradually from line to line. The first 
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line is marked 4 because the difference between a child 
who can read the first line and one who can read nothing 
at all is about four times as great — measured in years 
of work — as the difference between a child who can read 
line 4 and one who can read line 5, or as the difference 
between pupils who can read any other two successive 
lines. The seventh line is marked 10.5 because the words 
on it are a little too hard to stand half-way between lines 
9 and 11. There are only three words on line 11 because 
no others of precisely the same difficulty could be found. 



Thorndike Reading Scale A 
Visual Vocabulary 
Write your name here 



4 



Look at each word and write the letter F under 

every word that means a flower. 
Then look at each word again and write the letter 

A under every word that means an animal. 
Then look at each word again and write the letter 

N under every word that means a boys name. 
Then look at each word again and write the letter 

G under each word that means a game. 
Then look at each word again and write the letter 

B under every word that means a book. 
Then look at each word again and write the letter 

T under every word like now or then that means 

something to do with time. 
Then look at each word again and write the word 

GOOD under every word that means something 

good to be or do. 
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Then look at each word again and write the word 
BAD under every word that means something 
bad to be or do. 



4. camel, samuel, kind, lily, cruel 



5. cowardly, dominoes, kangaroo, pansy, tennis 



6. during, generous, later, modest, rhinoceros 



7. claude, courteous, isaiah, merciful, reasonable 



8. chrysanthemum, considerate, lynx, prevari- 
cate, reuben 

9. ezra, ichabod, ledger, parchesi, preceding 
10. crocus, dahlia, jonquil, opossum, poltroon 



10.5 begonia, equitable, pretentious, renegade, 
reprobate 

11. armadillo, iguana, philanthropic 
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The child's score or measure is determined by finding 
the hardest, or the highest-numbered, line that he marks 
with not more than a single error — all omissions being 
regarded as errors. The number of this line is talten as 
the child's score. For example, live children gave results 
as follows : 



NuMBFiR OF Omissions and Errors in Each Linb in the Case 
OF Five Pupils. C, J, N, R, and W 

Line 4 5 6 7 8 9 10 10,5 11 

Pupil C 000013 3 4 3 



Thus we may say that C has ability 8 ; J has ability 
10 ; N has ability 7 ; R has ability 8 ; W has ability 
10.5 or 11 or better. 

To measure the ability of a class as a whole, we simply 
take an average by adding together all the errors and 
omissions on each line and dividing by the number of 
children. In a rough estimate the class gets credit for 
the highest-numbered line that shows an average error 
of 1 or less, and the figure thus obtained, or the result as 
a whole, can be used for comparison with the achievement 
of other classes. 

Considering the five children above mentioned as a 
class, we have, as the average number of errors and 
omissions on each line, the following : 

line 456 7 8 9 10 10,5 11 

Errore (including 
omieaions) ..000 .2 10 2.0 2.4 3.2 (2.2 
for the three-word line 11 or 3.7 for 
a five-word line of equal difficulty) 
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Since the highest-numbered line that this class marked 
with not more than an average of one error or omission 
per child is line number 8, 8 may be considered the score 
or measure of this class. 

The choice of four out of five correct as a standard 
could be replaced by all correct {100%) or three correct 
(60%), but for statistical reasons 80% is the best criterion. 

The measures procured by this method are not only 
objective, but they have a definite meaning. For in- 
stance, to say that an individual or class possesses ability 
6 in reading, means that he or they possess the ability to 
mark correctly at least four out of five (80%) of the words 
in line 6 on the scale. Furthermore, the difference in 
difficulty between lines 4 and 5 is approximately equal 
to the difference in difficulty between lines 5 and 6, and 
so on. Lastly, since the difference in difficulty between 
lines 8 and 4 is probably about equal to that between 4 
and 0, the attainment of a class scored 8 may be said to 
be about twice as great as that of one scored 4. 

In the case of an individual, it is always possible to 
state in just what line are recorded errors and omissions 
totaling 20% or less (80% or more correct) ; that is, 
the individual's " degree of difficulty " can be accurately 
stated at sight. MTien it is a matter of an entire class, 
however, this is not so easy. For instance, a class may 
have a record of 16% of errors and omissions for line 6, 
and 25% for line 7. In such a case the " degree of diffi- 
tmlty " which would give a percentage of 20 may be 
obtained by consulting the tables and following the 
directions in the original paper. In short, when the 
percentage of errors or omissions for a given line, say 
6, is known, it is possible to estimate just the " degree 
of difficulty," say 6.7, which would give a percentage 
of exactly 20 (80% correct) for the class in question. 

The time required to measure a class of forty pupils, 
record the results, and estimate the " degree of difficulty " 
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that would give a percentage of 20 errors and omissions, 
varies from two to five hours. Thomdike believes it 
would be well for every school, from the fourth to the 
eighth grades, to make such measurements at the begin- 
ning and at the end of the school year. 

This scale is not without defects and limitations, some 
of which Thomdike is at present working to overcome. 
(1) A scale whose steps or lines contain 10 or 20 words, 
instead of 5, will obviously give data for a more precise 
estimate of the ability of a class. (2) When applied to a 
single pupil the scale is not so precise as when applied 
[, for a child who happened to be interested in 
flowers and animals would have a decided advantage 
over one who was not so interested in them. (3) A pupil's 
score cannot always be exactly stated ; for, if a child 
misses 2 words in line 8, no words in line 9 and 3 words 
in line 10, shall his ability be classed as 7 or 9? How- 
ever, a reasonably rough estimate of his ability may be 
gained by consulting his score in the other lines. In a 
class, the chance familiarity of a pupil with certain 
words will be counterbalanced by the chance imfamiliar- 
ity of some other pupil. (4) The fact that words ex- 
pressing relations, such as pronouns, prepositions, and 
conjunctions, are omitted in this scale, seems a serious 
limitation until it is considered that the chief importance 
of thrae words is in sentence comprehension, and that 
the scale for that purpose, which will be described later, 
tests knowledge of them rather thoroughly. (5) Not all 
the words on a given line are of absolutely equal difficulty, 
but the differences in the degree of difficulty are not of 
enough importance to constitute a defect. (6) It must 
be admitted that the differences between successive 
lines are not exactly equal. In fact, even " their ap- 
proximate equality depends upon the approximate truth 
of certain hypotheses about the distribution of word- 
knowledge in children of the same grade and about the 



comparative variability of the children in Grades IV, V, 
VI, VII, and VIII in respect to word-knowledge." 
(7) Lastly, it must be remembered that this scale does 
not measure the meaning of the printed words, save as 
required in the directions on the scale- 
In spite of the difficulties which any such scale pre- 
sents, it may be used for practical purposes, at its face 
value. It is capable of revealing large individual differ- 
ences within a class and of measuring them roughly, if, 
as Thomdike says, it is interpreted with common sense- 
Moreover, as a measure of " the ability to understand 
printed words imconfused with the ability to express 
one's self orally or in writing," it is superior to any form 
of definition test. By extending it to include more 
difficult words it may be used to measure achievement 
and improvement from the third grade through college. 
Indeed, with slight modification it can be used to measure 
extent of vocabulary in any foreign language, and in 
fact, such scales for French, German, and Latin are being 
planned. 

Scale A is designed for use in Grades IV to VIII in- 
clusive in the elementary schools and to some extent 
in the high schools. To be sure that the general nature 
of the scale is understood, a short, simple, preliminary 
test, similar in character to Scale A, should be given. 
A pupil who has made less than five errors and omissions 
in the first two lines taken together in the preliminary 
test may be assumed to understand the general idea of 
the scale. A pupil in the third grade or above who makes 
more than ten errors and omissions in the first two lines 
taken together, may be assumed not to understand what 
is required of him. In the fourth grade one half an 
hour should be allowed for the test, in the fifth and sixth 
grades twenty-five minutes, and in the seventh and 
eighth grades, twenty minutes. Although a time record 
is not used in the measurement of the vocabulary itself, 
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Thomdike believes that it should be kept, without the 
pupil's knowledge, since it will prove instructive and 
requires little labor. A little experience will soon teach 
the scorer what lines he need score for a given class. 
For instance, in the eighth grade lines 4, 5, and 6 may 
almost always be neglected, while in the fourth grade 
lines 10, 10,5 and 11 may safely be disregarded. 

The words of Scale A were chosen from a much larger 
number which were tried upon about 2500 pupils in the 
fourth, fifth, sixth, seventh and eighth grades in five 
different schools. Words were considered to be of ap- 
proximately equal difficulty if approximately equal per- 
centages of pupils in the fourth, fifth, sixth, seventh and 
eighth grades, respectively, marked them correctly in 
these tests. For instance, the words finally selected 
for row 4 in the scale — camel, samuel, kind, lily, and 
cruel — were marked correctly by approximately the same 
percentage of pupils in all the fifth grade classes, and sim- 
ilarly in the other grades ; that is, about 100% got each of 
them right in the eighth grade, about 99% in the seventh 
grade, 98% in the sixth grade and 96% in the fifth grade. 
At present it is planned to improve the scale so that 
each row will include ten words instead of five. Some 
of the words added will be similar to those already in 
the scale, such as boys' names, while others will be words 
of equal difficulty obtained by administering new tests. 
An attempt will also be made to find words of difficulty 
11.5, 12 and 12.5. With the material which he has 
already collected, Thomdike expects to enlarge Scale A 
by adding words of difficulty 4.5, 5.5, 6.5, 7.5, 8.5 and 9.5. 
In this way the exactitude of measurement of extent or 
range of visual vocabulary will be greatly increased. 
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(2) Scale Alpha. For Measuring the Uiiderstaiidiiig 

of Senteaces 
Thorndike's second scale, Scale Alpha, is an attempt 
to measure the ability of a child to read understandingly, 
that is, to understand the meaning of sentences and 
paragraphs. The value of such a scale is obvious when 
it is realized that competent judges would rate this 
ability "at from 60% to 90% of the total result to be 
sought by the elementary school in the teaching of 
reading." 

In constructing this scale, preliminary experimentation 
was conducted along two separate lines; namely, (1) meas- 
urement by the passage -question method and (2) measure- 
ment by responses in marking letters, numbers, and the 
like. The work in both of these lines was so successful 
in measuring the pupil's ability to read understandingly, 
I that the two types of measurement were employed in the 
I'final scale, which consists of four "sets" or steps, each 
lone of which contains from one to five questions. This 
|8Cale is reproduced below. 

SET a OR 4 
Read this and then write the answers. Read it again 
I as often as you need to. 

John had two brothers who were both tall. 
Their names were Will and Fred. John's sister, 
who was short, was named Mary. John liked 
Fred better than either of the others. All of these 
children except Will had red hair. He had brown 
hair. 
1. Was John's sister tall or short ? 

» 2. How many brothers had John ? 

1 3. What was his sister's name ? 



72 Scientific Meastirement 

SET b OR 6 

Read this and then write the answers. Read it again 
as often as you need to. 

Long after the sun had set, Tom was still wait- 
ing for Jim and Dick to come. '* If they do not 
come before nine o'clock," he said to himself, *' I 
will go on to Boston alone." At half past eight 
they came bringing two other boys with them. 
Tom was very glad to see them and gave each of 
them one of the apples he had kept. They ate 
these and he ate one too. Then all went on down 
the road. 



1. When did Jim and Dick come? 



2. What did they do after eating the apples ? . . . . 



3. Who else came besides Jim and Dick ? 



4. How long did Tom say he would wait for them ? 



5. What happened after the boys ate the apples ? 
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SET c OR 8 

Read this and then write the answers. Read it again 
as often as you need to. 

It may seem at first thought that every boy and 
girl who goes to school ought to do all the work 
that the teacher wishes done. But sometimes 
other duties prevent even the best boy or girl 
from doing so. If a boy's or girl's father died 
and he had to work afternoons and evenings to 
earn money to help his mother, such might be 
the case. A good girl might let her lessons go 
undone in order to help her mother by taking care 
of the baby. 

1. What are some conditions that might make 
even the best boy leave school work unfinished ? 



2. What might a boy do in the evenings to help 
his family? 

3. How could a girl be of use to her mother ? . . . . 



4. Look at these words: idle, tribe, inch, it, ice, 
ivy, tide, true, tip, top, tit, tat, toe. 

Cross out every one of them that has an i and 
has not any / (T) in it. 
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SET d OR 10 
5 the ansH 



Read i 



Read this and then write t 
as often as you need to. 

It may seem at first thought that every boy and 
girl who goes to school ought to do all the work 
that the teacher wishes done. But sometimes 
other duties prevent even the best boy or girl 
from doing so. If a boy's or girl's father died and 
he had to work afternoons and evenings to earn 
money to help his mother, such might be the case. 
A good girl might let her lessons go undone in 
order to help her mother by taking care of the 
baby. 

1. What is it that might seem at first thought to 
be true, but really is false ? 

2. What might be the effect of his father's death 
upon the way a boy spent his time ? 

3. Who is mentioned in the paragraph as the per- 
son who desires to have all lessons completely 
done ? 

4. In these two lines draw a line under every $ 
that comes just after a 2, unless the 2 comes 
just after a 9. If that is the case, draw a line 
imder the next figure after the 5 : 
536254174257654925386125 
473523925847925612574856 

The foregoing scales and tables in this section are reproduced 
by the courtesy of Dr. E. L. Thorndikh. 




In the first two sets or steps — " a or 4 " and " b or 
6"^of the scale just given, the first type of measure- 
ment or the passage-question method, is used. Here 
the ability to understand a sentence or paragraph is 
measured by the correctness of verbal responses to cer- 
tain questions asked regarding it. In the last two sets 
or steps ^ " c or 8 " and " d or 10 " — ability to under- 
stand a sentence or short paragraph is measured by re- 
sponses which are not entirely verbal in character, such 
as marking letters and numbers. Each one of the four 
" sets " or steps is more difficult than the preceding 
one. 

As in the case of Scale A, a preliminary test should 
be given the pupils before administering Scale Alpha, to 
find out if they understand instructions. Scale Alpha is 
available for Grades III to VIII. Twenty to thirty 
minutes should be allowed for administering it, and 
scoring is done as m Scale A. In marking the responses 
" the general intent should be to require an answer that 
proves that the pupil has understood the passage per- 
fectly." Because of the small number of steps in the 
scale, the " degree of difficulty " or, what amounts to 
the same thing, the ability of an individual or class, may 
be estimated from the percentage of errors and omissions 
nearest 20%, in a very similar manner to that used in 
Scale A; but for detailed directions the original paper 
must be consulted. 

Thomdike points out that the values for the steps of 
this scale are not at all exact ; that is, the difficulty of 
Set 4, for instance, is not exactly two and one-half times 
that of a possible Set 1, but he has permitted this estimate 
to stand, to facilitate the understanding of the scale. In 
order to obtain a scale of four or more steps, and make 
sure that all the questions in each step are of approxi- 
mately equal difficulty and that there is a uniform differ- 
ence in difficulty between the different steps, it will be 
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necessary to test over 4000 pupils, obtaining from each 
from 50 to 60 responses. 

As Thomdike points out, even though Scale Alpha is 
but provisional, its use will make comparison much fairer 
and more exact than hours of oral questioning on the 
part of the most capable supervisor of reading. The scale 
will eventually be extended and improved by adding 
other elements equal in difficulty to those now given 
and by filling in with intermediate steps. 



(3) The Gray Tentative Scale for Measuring Achievement 
in Oral Reading 

This provisional scale for measuring ability to pro- 
nounce English sentences consists of ten paragraphs of 
increasing reading difficulty. 

Passage a 
It was time for winter to come. The little birds 
had all gone far away. They were afraid of the cold. 
There was no green grass in the fields, and there were 
no pretty flowers in the gardens. Many of the trees 
had dropped all their leaves. Cold winter with its 
snow and ice was coming soon. 



Passage b 
Once there lived a king and queen in a large palace, 
but the king and queen were not happy. There were 
no little children in the house or garden. One day 
they found a poor little boy and girl at their door. 
They took them into the palace and made them their 
own. The king and queen were then happy. 
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Passage c 

Once I went home from the city for a summer's 
3st. I took my gun for a stroll in the woods where 
1 shot many squirrels. I put my gun against a 
i and lay down upon the leaves. Soon I was fast 
, dreaming of a group of merry, laughing children 
{running and playing about me on all sides. 

Passage d 

One of the most interesting birds which ever lived 
in my bird-room was a blue jay named Jakey. He was 
full of business from morning till night, scarcely ever 
still. He had been stolen from a nest long before he 
could fly, and he was reared in a house, long before he 
had been given to me as a pet. 



The part of farming enjoyed most by a boy is the 
making of maple-sugar. It is better than blackberry- 
ing and almost as good as fishing. One reason he likes 
this work is that some one else does most of it. It is a 
sort of work in which he can appear to be very indus- 
trious, and yet do but little. 

I Passage f 

I It was one of those wonderful evenings such as are 
' found only in this magnificent region. The sun had 
sunk behind the mountains, but it was still light. The 
twilight glow embraced a third of the sky, and against 
its brilliancy stood the dull white masses of the moun- 
t^ns in evident contrast. 




Passage g 

George Washington was in every sense of the word 
a wise, good and great man. But his temper was 
naturally irritable and high-toned. Through reflec- 
tion and resolution he had obtained a firm and habitual 
ascendancy over it. If, however, it broke loose its 
bonds, he was most tremendous in his wrath. 
Passage b 

Responding to the impulse of habit, Josephus spoke 
and the others listened attentively, but in grim and 
contemptuous silence. He spoke for a long time, con- 
tinuously, persistently and ingratiatingly. Finally ex- 
hausted through lack of nourishment, he hesitated. 
As always happens in that contingency, he was lost. 



The hypothesis concerning physical phenomena for- 
mulated by the early philosophers proved to be in- 
consistent and, in general, not universally applicable. 
Before relatively accurate principles could be estab- 
lished, physicists, mathematicians, and statisticians had 
to combine forces and work arduously. 

Passage j 
Read the following sentences correctly: Sophistry 
is fallacious reasoning. They resuscitated him. Ver- 
biage is wordiness. Equanimity is evenness of mind. 
He has a pertinacious, obstinate disposition. There 
was subtlety and poignancy in his remarks. A hypo- 
critical or Pharisaical nature is usually cynical. 

The Bcale and table m thia section are reproduced by the courtesy 
Of Mr. W. S. Gbay. 
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DIRECTIONS FOR ADMINISTERING 

Pupils are required to read these passages in order, 
stopping at the end of each paragraph. The gross errors, 
minor errors, omissions, substitutions, and insertions made 
in each passage, as well as the time needed to read it, 
are recorded in detail on a duplicate of the scale. When 
a child makes 4 or more errors and takes 30 seconds or 
more to read a given paragraph, or when he makes 5 or 
more errors, however quickly he reads, he may be con- 
sidered to have failed to read that passage. Although 
the difference in the degree of difficulty between any two 
of these passages has not as yet been definitely established, 
if values must be assigned to the ten paragraphs, Gray 
suggests that the following figures be used. 
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When finished, this scale will consist of an exactly 
graded series compiled from many graded series similar 
to the one just given. Even in this rough approximation 
to its final form, the scale is much better than any other 
means at hand for measuring ability in pronouncing Eng- 
lish sentences. 
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n. STARCH READING TESTS 
No. 1 

Once there was a little girl who lived 
with her mother. 

They were very poor. 

Sometimes they had no supper. 

Then they went to bed hungry. 

One day the little girl went into the 
woods. 

She wanted sticks for the fire. 

She was so hungry and sad ! 

"Oh, I wish I had some sweet por- 
ridge!" she said. 

"I wish I had a pot full for mother 
and me. 

We could eat it all up." 

Just then she saw an old woman with 
a little black pot. 

She said, "Little girl, why are you so 
sad?" 

"I am hungry," said the little girl. 



;d 
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No. 2 

Betty lived in the South, long, long 
go. She was only ten years old, but 
she liked to help her mother. 

She had learned to do many things. 
She could knit and sew and spin; but 
best of all she liked to cook. 

One day Betty was alone at home 
because her father and mother and 
brother had gone to town to see a won- 
derful sight. 

The great George Washington was 
visiting the South. He was going from 
town to town, riding in a great white 
coach trimmed with shining gold. It 
had leather curtains, and soft cushions. 
Four milk-white horses drew it along 
the road. 

Four horsemen rode ahead of the 
coach to clear the way and four others 
rode behind it. They were all dressed 
I in white and gold. 
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Little Abe hurried home as fast as his feet could 
carry him. Perhaps if he had worn stockings and 
shoes like yours, he could have run faster. But, 
instead, he wore deerskin leggings and clumsy 
moccasins of bearskin that his mother had made 
for him. 

Such a funny little figure as he was, hurrying 
along across the rough fields ! His suit was made 
of warm homespun cloth. His cap was made of 
coonskin, and the tail of the coon hung behind 
him, like a furry tassel. 

But if you could have looked into the honest, 
twinkling blue eyes of this Wttle lad of long ago, 
you would have liked him at once. 

In one hand little Abe held something very 
precious. It was only a book, but little Abe 
thought more of that book than he would have 
thought of gold or precious stones. 

You cannot know just what that book meant 
to little Abe, unless you are very fond of reading. 
Think how it would be to see no books except 
two or three old ones that you had read over and 
over xmtil you knew them by heart ! 



L^ 
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No. 4 

The red squirrel usually waked me in the dawn, 
coursing over the roof and up and down the sides 
of the house, as if sent out of the woods for this 
very purpose. 

In the course of the winter I threw out half a 
bushel of ears of sweet-corn on to the snow crust 
by my door, and was amused by watching the 
motions of the various animals which were baited 
by it. All day long the red squirrels came and 
went, and afforded me much entertainment by 
their maneuvers. 

One would approach, at first, warily through 
the shrub-oaks, running over the snow crusts by 
fits and starts like a leaf blown by the wind. Now 
he would go a few paces this way, with wonderful 
speed, making haste with his "trotters" as if it 
were a wager ; and now as many paces that way, 
but never getting on more than half a rod at a 
time. 

Then suddenly he would pause with a ludicrous 
expression and a somerset, as if all eyes in the 
universe were fixed on him. Then, before you 
could say Jack Robmson, he would be in the top 
of a young pitch-pine, winding up his clock and 
talking to all the universe at the same time. 
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No. 5 

Once ujwn a time, there lived a very rich man, and a 
king besides, whose name was Midas; and he had a little 
daughter, whom nobody but myself ever heard of, and 
whose name I either never knew, or have entirely forgotten. 
So, because I love odd names for httle girls, I choose to 
call her Marygold. 

This King Midas was fonder of gold than anything else 
in the world. He valued his royal crown chiefly because 
it was composed of that precious metal. If he loved any- 
thing better, or haK so well, it was the one little maiden 
who played so merrily around her father's footstool. But 
the more Midas loved his daughter, the more did he desire 
and seek for wealth. He thought, foolish man ! that the 
best thing he could possibly do for his dear child would be 
to give her the immensest pile of yellow, glistening coin, 
that had ever been heaped together since the world was 
made. Thus, he gave all his thoughts and all his time to 
this one purpose. If ever he happened to gaze for an in- 
stant at the gold-tinted clouds of sunset, he wished that 
they were real gold, and that they could be squeezed safely 
into his strong box. When httle Marygold ran to meet him, 
with a bunch of buttercups and dandelions, he used to say, 
" Poh, poh, child ! If these flowers were as golden as they 
look, they would be worth the plucking!" 

And yet, in his earlier days, before he was so entirely 
possessed of this insane desire for riches. King Midas had 
shown a great taste for flowers. 
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No. 6 

In a. secluded and mountainous part of Stiria there was 
in old times a valley of the most surprising and luxuriant 
fertility. It was surrounded on all sides by steep and rocky 
mountains, rising into peaks which were always covered 
with snow, and from which a number of torrents descended 
in constant cataracts. One of these fell westward over the 
face of a crag so high that, when the sun had set to every- 
thing else, and all below was darkness, his beams still shone 
full upon this waterfall, so that it looked hke a shower of 1 

gold. It was, therefore, called by the people of the neigh- 
borhood, the Golden River. It was strange that none of 
I these streams fell into the valley itself. They all descended 
I on the other aide of the mountains, and wound away through 
broad plains and past populous cities. But the clouds were 
■ drawn so constantly to the snowy hills, and rested so softly 
I in the circular hollow, that in time of drought and heat, 
when all the country round was burnt up, there was still 
rain in the little valley ; and its crops were so heavy and its 
hay so high, and its apples so red, and its grapes so blue, 
and its wine so rich, and its honey so sweet, that it was a 
marvel to every one who beheld it, and was commonly caDed 
the Treasure Valley. 

The whole of this little valley belonged to three brothers 
called Schwartz, Hans and Gluck. Schwartz and Hans, the 
I two elder brothers, were very ugly men, with overhanging 
[ eyebrows and email, dull eyes. 



No. 7 

Captain John Hull was the mmt-master of Massachusetts, 
and coined all the money that was made there. This was a 
new line of business, for in the earlier days of the colony 
the current coinage consisted of gold and silver money of 
England, Portugal, and Spain. These coins being scarce, 
the people were often forced to barter their commodities 
instead of selling them. 

For instance, if a man wanted to buy a coat, he perhaps 
exchanged a bearskin for it. If he wished for a barrel of 
molasses, he might purchase it with a pile of pine boards. 
Musket-bullets were used instead of farthings. The In- 
dians had a sort of money called wampum, which was made 
of clamshells, and this strange sort of specie was likewise 
taken in payment of debts by the English settlers. Bank- 
bills had never been heard of. There was not money enough 
of any kind, in many parts of the country, to pay the salaries 
of the ministers, so that they sometimes had to take quintals 
of fish, bushels of corn, or cords of wood instead of silver or 
gold. 

As the people grew more numerous and their trade one 
with another increased, the want of current money was 
still more sensibly felt. To supply the demand the general 
court passed a law for establishing a coinage of shillings, 
sixpences, and threepences. Captain John Hull was ap- 
pointed to manufacture this money, and was to have about 
one shilhng out of every twenty to pay him for the trouble 
of making them. 
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No. 8 

The years went on, and Ernest ceased to be a boy. He 
had grown to be a young man now. He attracted little 
notice from the other inhabitants of the valley ; for they 
Baw nothing remarkable in his way of life, save that, when 
the labor of the day was over, he atill loved to go apart and 
gaze and meditate upon the Great Stone Face. According 
to their idea of the matter, it was a folly, indeed, but par- 
donable, inasmuch as Ernest was industrious, kind, and 
neighborly, and neglected no duty for the sake of indulging 
this idle habit. They knew not that the Great Stone Face 
had become a teacher to him, and that the sentiment which 
was expressed in it would enlarge the young man's heart, 
and fill it with wider and deeper sympathies than other 
hearts. They knew not that thence would come a better 
wisdom than could be learned from books, and a better hfe 
than could be molded on the defaced example of other 
human lives. Neither did Ernest know that the thoughts 
and affections which came to him so naturally, in the fields 
and at the fireside, and wherever he communed with him- 
self, were of a higher tone than those which all men shared 
with him. 

By this time poor Mr. Gathergold was dead and buried ; 
and the oddest part of the matter was, that his wealth, 
which was the body and spirit of his existence, had disap- 
peared before his death, leaving nothing of him but a Uving 
skeleton, covered over with a wrinkled, yellow skin. Since 
the melting away of his gold, it had been very generally 
conceded that there was no such striking resemblknoe, after 
all, betwixt the ignoble features of the ruined Btwchant 
and that majestic face upon the mountainside. 
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No. 9 

To an American visiting Europe, the long voyage he has 
to make ia an excellent preparative. The temporary 
absence of worldly scenes and employments produces a 
state of mind peculiarly fitted to receive new and vivid 
impressions. The vast space of waters that separates the 
hemispheres is like a blank page in existence. There ia no 
gradual transition, by which, as in Europe, the features and 
population of one country blend almost imperceptibly with 
those of another. From the moment you lose sight of the 
land you have left, all is vacancy until you step on the 
opposite shore, and are launched at once into the bustle 
and novelties of another world. 

In traveling by land there is a continuity of scene and a 
connected succession of persons and incidents, that carry on 
the story of life, and lessen the effect of absence and separa^ 
tion. We drag, it is true, "a lengthening chain," at each 
remove of our pilgrimage ; but the chain is unbroken : we 
can trace it back link by link ; and we feel that the last still 
grapples us to home. But a wide sea voyage severs us at 
once. It makes us conscious of being cast loose from the 
secure anchorage of settled life, and sent adrift upon a 
doubtful world. It interposes a gulf, not merely imaginary, 
but real, between us and our homes — a gulf subject to 
tempest, and fear, and uncertainty, rendering distance pal- 
pable, and return precarious. 

The teats and standard scorea in thia section are reproduced by the 
courtesy of Dr. Daniel Starch. 




DIRECTIONS FOR ADMINISTERING TESTS 

The series of tests published by Starch are designed to 
measure (1) comprehension of material read, (2) speed of 
reading, and (3) correctness of pronunciation. These 
tests, nine in number, are actually a graded series of 
passages chosen from various graded readers, each of 
them bearing a number which indicates the grade from 
which it was taken and in which it is to be used. For 
example, No. 1 is to be used in the first grade ; No, 2, in 
the second grade ; and so on. It should be noted that 
full directions for administering the tests accompany 
them. 

Explain to the pupils that they are to read silently as 
rapidly as they can and at the same time to grasp as much 
as they can, and that they will be asked to write down, 
not necessarily in the same words, as much as they will 
remember of what they read. 

They should also be told not to read anything over, 
but to read on continuously as rapidly as is consistent 
with grasping what they read. 

Use for a given grade the test blank that bears the 
same number as that grade. For example, use No. 4 
with the foiu^;h grade, No. 5 with the fifth grade, etc. 
On the next day repeat the test in the same manner, but 
use the blank of the grade next below yours ; that is, in 
the fourth grade use No. 3, in the fifth grade use No. 4, etc. 

The blanks for the test should be distributed to the 
pupils with the backs of tke blanks up, so that no one will 
be able to read any of the material until all are ready. 
Then give the signal "turn" and "start." Allow them 
to read exactly thirty seconds. Then have the pupils 
make a mark with pencil after the last word read to indi- 
cate how far they had read. 

Then have them turn the blanks over immediately and 
write on the back all that they remember having read. 
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Allow as much time as they need, but make sure that 
they do not copy from one another, or turn the blank over 
to see the text. Finally, have them fill out the spaces at 
the bottom of the blank. 

Make sure of allowing exactly 30 seconds for the read- 
ing. See that all pupils start and stop at the same time. 

Since selection No. 1 was taken from a typical first 
grade reader, selection No. 2 from a typical second grade 
reader, and so on, it was assumed that the increase in 
difficulty from one passage to another was fairly uniform. 
Nevertheless, Starch carefully examined all the data 
obtained from administering the teats to about 1400 
pupils. These data indicated that the assumption was 
correct that the passages increase in difficulty with ap- 
proximate uniformity from step to step. They also 
seemed to show that, unless the selections have been read 
shortly before by the pupils tested, the value of the tests 
is not affected by the fact that some of the selections are 
more or less familiar fables or pieces of literature. 

(1) Reading Comprehension Test 
In using the test to measure reading comprehension, 
the pupil is given a limited time — thirty seconds — to 
read as much as he can of the selection. He is then re- 
quired to write out as much as he can of what he has read. 
The exact amount of understanding shown is determined 
by counting the number of words written which correctly 
express the thought of the selection. All words which 
reproduce the ideas of the test passage incorrectly, all 
words expressing added ideas or repeated ideas, are 
crossed out, and the number of remaining words is 
reckoned as the measure of comprehension. For instance, 
if a pupil in reproducing teat No. 8, a selection of 142 
words, uses 77 words and 5 are crossed out, his score is 72. 
Starch answers the objection to written reproduction 
as an index of comprehension, by saying that if it is a 




handicap it is the same for all, since the pupil who is at a 
distinct disadvantage in writing, as compared with speak- 
ing, is either very rare or fictitious. Immediate repro- 
duction was thought best because it does away with the 
memory factor and imposes uniformity. The immediate 
memory span of an adult in verbatim reproduction of 
words in sentences is 25 words, and that of a child of 
six about 12 words, but In the time allotted for the test, 
the average eighth grade child will read 120 words and 
the average first grade pupil will read 45 words. There- 
fore, the chance of a child's memorizing a great part of 
the passage is eliminated by the length of the selection. 

Another possible way of testing comprehension is to 
measure the ability of a child to answer certain questions 
concerning the test passage. This method was actually 
tried, but the results from its use were less accurate and 
more difficult to score than those from the method finally 
adopted. 

The method of scoring comprehension by counting the 
number of words written which correctly reproduce the 
thought of the test passage, was adopted because" it is 
"simple, rapid and objective." Two other methods, 
that of assigning percentage marks and that of finding 
the number of ideas correctly expressed, might have been 
used ; but the former was disregarded because of its sub- 
jective character, and the latter, because it involved the 
difficulty of determining just what an idea is. For in- 
stance, is " hurried " a separate idea, or should " hurried 
along " be considered as one? 

(2) Test for Speed of Reading 
The speed of reading is easily measured by determining 
how much of a given test passage the child is able to 
read in thirty seconds. By using a blank on which the 
number of words is indicated line by line to the end of 
flie passage, the total number of words read in a given 



time may be seen at a glance. This, number, divided by 
thirty, is the child's score per second. Thirty seconds 
was chosen as the time limit, first, because " the neces- 
sary text for this interval could all be printed on a sheet 
of paper about the size of an ordinary page in a reader ; 
and second, because a longer interval of time would in- 
crease very materially the labor of scoring the results." 
To ascertain whether thirty seconds is a long enough 
interval to test a pupil's reading capacity, preliminary 
tests were made which showed that both speed and com- 
prehension remain nearly constant, irrespective of the 
length of the passage. 

(3) Test for Correctness of Pronunciation 
Correctness of pronunciation is measured by noting 
the number of words pronounced incorrectly. The test 
is administered after the other two tests are completed, 
and when the pupil has, in consequence, acquired a certain 
familiarity with the passage. Of course, this test must 
be given individually and out of the hearing of the other 
pupils. 

To test the validity of these measurements of reading 
capacity, a comparison was made in a school of 256 pupils 
between efficiency in reading as shown by the tests and 
as indicated by marks in reading assigned by teachers. 
The relation between the results of the tests and the read- 
ing as estimated by the teachers was close. 

STANDARD SCORES IN READING 

On the basis of the results from the administration of 

the tests to over 3500 children in 15 schools in 7 cities 

and 3 states, the following tentative standard scores of 

efficiency have been made for each grade. 
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These tests show that great individual differences exist 
among pupils in the same grade. For example, in one 
of the fourth grades tested, one pupil showed a speed of 
reading of .8 words per second and another, of 4.7, Since 
the standard for speed in the first grade is 1,5 words per 
second and in the eighth grade, 4,0 words per second, the 
former pupil falls considerably below the standard of the 
first grade and the latter rises above the standard of the 
eighth grade. The same holds true of comprehension. 
In combined speed and comprehension the best pupil in 
one fourth grade made a score four and one half times 
as high as the poorest. 

This wide difference in ability in a single grade means 
that a large amount of overlapping exists between dif- 
ferent grades. In fact, on the basis of the studies made 
60 far with these tests, it may be said that " one third of 
the pupils of any given grade could do the reading work 
of the next grade above as well as the average of that 
grade, one fifth could do the work of the second grade 
above as well as the average of that grade, and one 
eighth could do the work of the third grade above as well 
B the average of that grade." 




Courtis has constructed two different reading tests, 
one to measure rate and retention in normal reading 
(Test No. 4, Normal Reading, Series C) and the other to 
measure rate and retention in careful reading (Test No. 5, 
Careful Reading, Series C}. 

Rate of Tiormal reading is determined by telling the child 
to read a selected passage for one minute at his natural 
rate of reading. (This test will be found reproduced on 
pages 96 and 97.) 

At the end of this time the pupil is to draw a circle 
around the last word he has read. Since the words are 
numbered to the end of the passage his rate of reading 
may be quickly determined. 

Retention in normal reading is measured by giving the 
pupil a sheet of paper on which is the story that he has 
just read, but having in it here and there groups of three 
words (in parentheses), two of which words were not 
used in the original story. (See pages 98 and 99.) 

He is to cross out the words which he does not re- 
memtier seeing before, and, if he is unable to recall whether 
he has seen them or not, he is to cross them all out. He 
is to continue this until he comes to the word at which 
he stopped in the original story. For remembering to 
stop at this place he is given credit for one point. 

Scoring is done by means of an Answer Card (see 
page 104) which gives the correct words used in the orig- 
inal story. This is placed beside the pupil's paper and 
every word which has been correctly crossed off is counted 
as a point. By adding these points the pupil's score in 
retention is obtained. 

The rate of careful reading is determined in a similar 
manner. Retention, however, is measured by the amount 
of the selected passage that the child is able to reproduce. 
(See tests on pages 100 and 101.) 
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Scoring is done by means of an Answer Card (see 
pages 102 and 103) which contains a list of the points or 
main ideas in the passage. For the reproduction of each 
of these ideas the pupil is given a credit of one. His 
final score is the sum of these credits. 

The following tests (pages 96 to 104) are reproduced by the cour- 
tesy of Mr. S. A. Courtis. 
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To summarize then, a teacher of the fourth, fifth, sixth, 
seventh or eighth grade may test the abihty of pupils, 
(1) in the understaTidvng of single words by using Thorn- 
dike's Scale A, (2) in the comprehension of material read, 
by using Thomdike's Scale Alpha, the Starch series of 
tests, or the Courtis tests, and (3) in the rate of reading, 
by using either the Starch or the Courtis tests, preferably 
the Starch. 

Thomdike's Scales may be obtained by sending to 
Teachers College, Columbia University, New York, and 
the Starch Reading Tests, by sending to the author at 
the University of Wisconsin. The sheets on which the 
scales and tests appear contain full directions for their use. 

In using Scale A the teacher should allow thirty minutes 
for the test in the fourth grade, twenty-five minutes in 
the fifth and sixth grades, and twenty minutes in the 
seventh and eighth grades. In administering Scale Alpha 
the teacher should allow from twenty to thirty minutes. 
In Scale A the pupil's score is the highest numbered line 
that he marks correctly without more than a single error. 
Scale Alpha is scored in a similar manner ; that is, the 
pupil's score is the highest numbered step or set in which 
he has answered at least three of the four questions 
correctly. 

In using the Starch Tests the teacher should send for 
the test blank that bears the same number as her grade ; 
for example. No, 4 for the fourth grade, No. 5 for the 
fifth grade, etc. The speed of reading is obtained by 
determining the number of words read in thirty seconds. 
The pupil's score is determined by counting the number 
of words in his written reproduction which correctly 
express the thought of the selection read. Added and 
repeated words, as well as those which represent the ideas 
of the selection incorrectly, are not counted. 

Folders or manuals, covering every phase of the test- 
ing, together with answer cards, must be procured with 
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the teat sheets if the Courtis Tests are to be used. These 
may be obtained by sending to the Department of Co- 
operative Research, 82 Eliot Street, Detroit, Michigan. 
To measure oral reading Gray's Scale may be used. 
In reading the paragraphs in the scale, which gradually 
increase in difficulty, the gross errors, minor errors, omis- 
sions, substitutions, and insertions made in each para- 
graph are recorded. If a child mak^ 4 or more errors 
in a paragraph and takes 30 seconds or more to read it, 
or if he makes 5 or more errors, however quickly he reads, 
he may be considered to have failed in that paragraph. 
This scale may be obtained by sendmg to Teachers Col- 
lege, Columbia University, New York City. 



EXERCISES 

1. Describe in detaU the methods you would employ for n 
ing the reading ability, oral and silent, of thirty children of Grade V, 
using (a) the Thomdike and Gray Scale and (b) the Starch Scale, 

2. How would you compare your class with one of the same grade 
in another school, using the Starch Scale? What conditions would 
you have to meet to make the comparison of the results valid? 

3. How do the results obtained from the Thomdike Scale compare 
with those which the Starch Scale give? 

4. Does there seem to be any relation between speed of reading 
and comprehension of material read? 

5. What distinctions between oral and silent reading have the 
testa revealed? 

6. Have the teats revealed any marked difierence in the reading 
ability ot boys and girts? Of children of different nationalities? Of 
children who have used different reading teittbooks? 

7. In what way may a teacher modify Scale A so as to use it to 
teflt knowledge in various subjects in the curriculum from the ele- 
mentary grades through college? 

8. When should a teacher stop drill in oral reading and devote all 
the time to drill in comprehension? 

9. Have the tests revealed wide variations in the reading ability 
of the pupils in your class or a condition of more or less uniformity? 

10. Wliat are the shortcomings of the scales described in this 
chapter? How could these be remedied? 





SPELLING SCALES 

I. BUCKINGHAM SCALE 
n. STARCH SCALE 
m. AYRES SCALE 

I. BUCKIMGHAM SPELLING SCALE 

This investigation, following the lead taken by the ex- 
perimental investigation of the quality of handwriting and 
of composition, had as its object the development of a scale 
for the measurement of spelling ability ; a scale which 
would no longer depend upon chance selection of words 
and upon subjective judgments of teachers, but which 
would be of general application and purely objective. The 
results were first published in 1913. 

It is an obvious fact that there is a great difference in 
words as regards ease of spelling. Thus, we can select 
words of the very simplest, such as ifie, as, when, up to 
words of extreme difficulty which can only be spelled after 
long acquaintance. Theoretically, therefore, it is possible 
to arrange a series of words along a scale in such a way that 
they become more and more difficult. Furthermore, it 
might be possible to arrange these words at equal mter- 
vals along the scale, these intervals being determined by 
the difficulty of each word. If ui addition to this we fix 
a zero point (by taking the simplest words and agreeing 
that failure to spell these words indicates absence of spell- 
ing ability), a scale may be constructed which will meas- 
ure the spelling ability of any individual, and will measure 
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the dij05culty of any word which has to be spelled. Not 
only can we measure the spelling ability of individuals in 
this way, but also of classes, schools, and school systems. 

Such measurements will be independent of individual 
opinion. Spelling ability will be determined, not by an 
arbitrary list of words, picked at random by individuals 
who have no knowledge of their relative degrees of diflB- 
culty, but by means of words on the scale, which have 
been standardized as regards their dij05culty, by the simple 
device of finding out what percentage of eighth grade 
children spelled them correctly. The school has always 
attached great importance to spelling ability; whether 
or not this ability is overestimated, does not need discus- 
sion here. Suffice it to say, that if the school takes as its 
aim the teaching of spelling, it is essential that some 
method be devised to measure the extent to which the 
aim is accomplished. 

Dr. Rice, as early as 1897, tested the pupils in all grades 
from the fourth to the eighth inclusive in twenty-one 
school systems, using a list of words, which has since 
become known as the Rice Sentence Test. This list is 
given on the following page. 
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RICE 


SENTENCE LIST 




^m 1. 


running 


30. 


writing 


69. 


sensible 


^H ^' 


slipped 


31. 


language 


60. 


business 


^H 3. 


listened 


32. 


careful 


61. 


answer 


^H 4. 


queer 


33. 


enough 


62. 


sweeping 


^H ^' 


speech 


34. 


necessary 


63. 


properly 


^m 6. 


believe 


35. 


waiting 


64. 


improvement 


^H ''' 


weather 


36. 


disappoint 


65. 


fatiguing 


^1 ^' 


changeable 


37. 


often 


66. 


anxious \ 


^B °' 


whistling 


38. 


covered 


67. 


appreciate 


10. 


frightened 


39. 


mixture 


68. 


assure 


11. 


always 


40. 


getting 


69. 


imagine 


12. 


changing 


41. 


better 


70. 


peculiar 


■ 13. 


chain 


42. 


feather 


71. 


character 


Pu. 


loose 


43. 


light 


72. 


guarantee 


^ 15. 


baking 


44. 


deceive 


73. 


approval 1 


16. 


piece 


45. 


driving 


74. 


intelligent 1 
experience 


17. 


receive 


ie. 


surface 


75. 


18. 


laughter 


47. 


rough 


76. 


delicious 


19. 


distance 


48. 


smooth 


77. 


realize 


20. 


choose 


49. 


hopping 


78. 


importance 


21. 


strange 


50. 


certainly 


79. 


occasion 


22. 


picture 


51. 


grateful 


80. 


exceptions 


K23. 


because 


52. 


elegant 


81. 


thoroughly 


■ 24. 


thought 


53. 


present 


82. 


conscientious 


^ 25. 


purpose 


54. 


patience 


83. 


therefore 


26. 


leam 


55. 


succeed 


84. 


ascending 


27. 


lose 


56. 


severe 


85. 


praise 


^28. 




57. 


accident 


86. 


wholesoiTie 


t 


neighbor 


58. 


sometimes 




. 
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The method of scoring was of the simple type which is 
usually found in schools, i.e. a mark was given for each 
word correctly spelled, or a unit subtracted for each word 
misspelled. That is, all words were taken as equal 
measures of spelling ability. It should be noted that 
the foregoing list contains among other words, disappoint, 
necessary, changeable, better, because, picture. An examina- 
tion of these six words shows at once that they are by 
no means of equal difficulty. This was conclusively 
proved by Thomdike, who made an actual test of these 
words on a group of fifth grade children. Thus, in the 
group that he measured, while 37% failed to spell neces- 
sary, the failures to spell better, because, and picture, were 
3%, 1%, 0%, respectively. This clearly shows that it is 
erroneous to measure the score of the individual by giving 
equal value to each of these words. The pupil who scores, 
let us say, 95%, has spelled not only all the easy words in 
the list, but also a considerable number of the hard ones, 
whereas the pupil who gets 50% has failed in the hard 
words, and has obtained his mark merely by spelling the 
easy words. That is, as the score increases, the units 
really get greater and greater, for to spell the five hardest 
words represents a very different task from spelling the 
five easiest words, and yet both have the same effect on 
the score. In other words, studies of this type must 
always lack precision because of the inequality of the units 
which are employed. They are useful for giving a rough 
estimate of the abilities of various groups, but when it 
comes to asking questions, such as : How does the spell- 
ing ability of one class differ from another? — the figures 
which represent the results give no quantitative informa- 
tion, and are actually misleading. As the science of 
school measurement advances, such a state of affairs can 
hardly be tolerated. Exact quantitative measurements 
of spelling ability are required ; such quantitative results 
can never be obtained so long as the fundamental error 
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!s made, that one word is equal to another word in 
difficulty, unless this is proved to be the case by actual 
measurements of large groups. To correct this error 
was the purpose of Buckingham's study of spelling 
ability. 

The study was confined to grades from the third to the 
eighth, inclusive, of elementary schools located in or near 
the city of New York. The schools drew such different 
classes of children that any conclusions derived as a result 
of the study can be taken as representative. In all, about 
9000 pupils were tested, a number from which general - 
results might be expected ; a greater number of pupils 
would not have increased the accuracy of the results 
sufficiently to compensate for the additional labor. 

In the first test a list of 270 words was used. This will 
be called the "original list." This list was selected from 
a larger list of 5000 words taken from two or more of 
five special books used by the author in his own school. 
These 270 words had to satisfy two requirements : (1) All 
of them had to be words in the speaking vocabulary of a 
third grade child, and (2) a considerable portion of the 
words had to be of sufficient difficulty to test the spelling 
ability of an eighth grade child. These words were then 
placed in a continuous passage, and the whole dictated 
to Grades III to VIII in one school and to Grades IV to 
VII in another school. The dictation was very slow, so 
that the time factor did not enter. In marking the papers 
only the 270 words were regarded, those that served to 
link the whole into a continuous passage being neglected. 
All the papers were marked by the same person and two 
measurements were recorded: (1) the number of times 
each word was correctly spelled in each grade, and (2) the 
percentage of the entire number of words each pupil 
spelled correctly in each grade. We shall confine our- 
selves to the first consideration, i.e. to the number of times 
each word was correctly spelled. 
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TABLE I 

Figures Indicate Per Cent Correct 
Table reads: across was spelled correctly in the third grade of 
School II by 17% ot the pupils; in the fourth grade of School I by 
60% of the pupils, and of School II by 40% ot the pupils, etc. 
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26 
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45 
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46 
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choose .... 


G 


26 
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67 


55 
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100 


100 
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29 


17 


67 


30 


77 


50 


82 


66 


85 


handful. . . . 


36 


47 


33 


46 


19 


76 


33 


7.-3 


63 


57 


pshaw .... 


1 


4 


6 


29 


6 


46 


5 


31 


31 


18 


tomato , . . 


34 


83 


49 


67 


43 


74 


48 


79 


32 


38 


too 





10 


3 


17 


4 


26 


7 


63 


22 


■27 


whose .... 


17 


49 


15 


40 


29 


47 


10 


57 


59 


66 



Table I represents the typical results obt^ned from 
the various grades in the particular schools. Thus for 
example, across was spelled correctly in the third grade of 
school II by 17% of the pupils, and in the seventh grade 
of school I by 98%. On the basis of these scores a group 
of 100 words, here called the " selected list," was chosen 
from the original list of 270 words. 

The basis upon which the "selected list" was chosen is 
as follows : Referring to Table I, it will be seen that the 
word across was spelled by 17% of the third grade children, 
which means that it was not too hard to serve as a test of 
their ability. By the time the seventh and eighth grades 
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were reached, it still served as a test of ability, for it failed to 
be spelled in the seventh and eighth grades by 13% and 7%, 
respectively. For this reason the word across was selected. 
Almost and button were chosen for the same reason. On the 
other hand, addition, which was spelled by only 2% of the 
third grade children, was discarded as too difficult, for 2% 
could spell it rightly by mere chance, which means that 
I the word really serves as no test for the particular grade. 

r Continuous Passage — lOO Selected Words 

Whose answer is ninety? If the janitor sweeps, he 
will raise a dust. You ought not to steal even a penny. 
Wait until the hour for recess to Umch the button. 
Smoke was coming out of their chimney. Every after- 
noon the butcher gave the hungry dog a piece of meat. 
One evening a carriage was stopping in front of my 
kitchen. I wear a number thirteen collar. Guess what 
made me sn£eze. Send me a pair of leather shoes. I 
do not know, but I am almost sure they are mine. My 
uncle bought my cousin a pretty watch for forty dollars. 
The soldier dropped his sword. Jack had a whistle and 
also twelve nails. The ocean does not often freeze. You 
should speak to people whom you meet. It takes only 
a minute to pass through the gate and across the road. 
Did you ever hear a /airy lau^h? The Awiericcin 
Indian had a soMCfir without a cup. Neither a pear nor 
a peach was at the grocery store to-day. Cut up a wiftoie 
omtra with a handful of beans. My piavio Wesson was 
eosy. The animal ran into the road and straight against 
a tree. Give me another sentence which has the word 
"title" in it. I believe true friends like to be together 
instead of apart. 
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These 100 selected words (printed in italics) were again 
put into sentences as shown (page 113) and were dictated 
later to five schools. Great care was taken to insure uni- 
formity in the administration of the tests. Later 18 addi- 
tional words were added, making a total of 118 words 
dictated. The extent to which each of these 118 words was 
spelled correctly in each grade in each school was deter- 
mined. Using the data so collected, it was possible to 
select words which show a regular increase in difficulty, as 
we pass down from grade to grade. From these words 
two lists were then selected, each containing 25 words; 
these are referred to as the "first preferred list" and 
"second preferred list," as tabulated below. 









PREFERRED LIST 










Fmn 






Secowi 




1. 


even 


14. 


minute 


26. 


ah^ady 


39. 


too 


2. 


lesson 


15. 


cousin 


27. 


beginning 


40. 


towel 


3. 


only 


16. 


nails 


28. 


chicken 


41. 


Tuesday 


4. 


smoke 


17. 


janitor 


29. 


choose 


42. 


lying 


6. 


front 


18. 


saucer 


30. 


circus 


43. 


whole 


6. 


sure 


19. 


stopping 


31. 


grease 


44. 


against 


7. 


pear 


20. 


sword 


32. 


pigeons 


45. 


answer 


8. 


bought 


21. 


freeze 


33. 


quarrel 


46. 


butcher 


9. 


another 


22. 


touch 


34. 


saucy 


47. 


gueas 


10. 


forty 


23. 


whistle 


35. 


tailor 


48. 


instead 


11. 


pretty 


24. 


carriage 


36. 


telegram 


49. 


raise 


12. 


wear 


25 


nor 


37. 


telephone 


60 


beautiful 


13. 


button 






38. 


tobacco 







Considering these 50 words alone, Table II shows the 
percentage of children from the third to the eighth grade, 
who were able to spell each of the 50 words. Thus, even 
was spelled correctly by 59% of children in the third 
grade, 93% in the sixth, and 97% in the eighth grade. 



i 



Spelling Scales 



115 



TABLE II 
(Showing Standard Scores ir 



4 

i 



WOHM 


30 Yb. 


4th Yb. 


6tb Ye, 


6th Ye. 


7th Ye. 


8rB Yb. 


1. even . . 


59% 


79% 


89% 


93% 


93% 


97% 


2. lesson . 




37 


72 


83 


91 


94 


96 


3. only . 




65 


75 


89 


95 


97 


99 


4. smoke . 




46 




85 


94 


96 


99 


6. front . 




61 


72 


80 


90 


94 


97 


6. Bure . 




47 


66 




78 




94 






31 


42 


58 


72 


81 


94 


8. bouLht' 




40 


65 


79 


91 


94 


97 








43 


78 


86 


94 


96 


10. forty . 




49 


62 


65 


72 


83 


87 


11. pretty . 




45 


67 


76 


90 


90 


94 


12. wear . 




35 


49 


61 


74 


84 


93 


13. button 




32 


52 


61 


73 


74 


87 


14. minute 




26 




62 


77 


86 


92 


15. cousin . 




19 


47 


69 


89 


89 


95 


16. nails . 




43 


58 


71 


87 


92 


96 


17. janitor 




19 


42 


68 


81 


81 


90 


18. kucer . 




11 


29 


42 


58 


79 


81 


19. stopping 




27 


39 


66 


71 


76 


84 


20. sword . 




13 


46 


57 


78 


86 


93 


21. freeze . 




29 


46 


68 


83 


86 


94 


22. touch . 




45 


62 


60 


81 


84 


93 


23. whistle 




22 


65 


56 


64 


75 


86 


24. carriage 




13 


40 


60 


67 


81 


86 


26. nor. . 




63 


61 


65 




77 


94 


26. already 




16 


42 


43 




44 


77 


27. beeinning 




9 


25 


37 


46 


66 


75 


28. chicken 




49 


70 


83 


90 


96 


99 


29. choose 




22 


34 


48 


60 


66 


82 


30. circus . 




20 


39 


50 


72 


76 


96 


31. grease . 




11 


18 


37 


35 


42 


67 


32. pigeons 




7 


29 


41 


57 


70 


82 


8S. quarrel 




15 


39 


53 


75 


86 


94 


34. saucy . 




14 


35 


40 


52 


71 


78 


35. taaor . 




38 


56 


70 


75 


81 


84 


86. telegram 




15 


31 


39 


63 


73 


84 


37. telephone 




8 


35 


48 


67 


83 


87 


S8. tobacco 




12 


39 


60 


76 


88 


96 


V»9. too . . 




14 


28 


27 


24 


30 


43 


■40. towel . 




24 


44 


64 


73 


78 


94 


41. Tuesday 




46 


70 


67 


80 


87 


91 


42. tying . 

43. whofe . 




44 


58 


70 




76 


87 




17 


43 


64 


78 


84 


90 


44. against 




19 


30 


54 


76 


84 


94 


46. answer 




27 


47 


67 


86 


90 


97 


46. butcher 




33 


59 


69 


85 


90 


97 


47. guess . 




20 


32 


49 


67 


77 


86 


48. instead 




32 


48 


62 


86 


87 


91 


49. raise . 




21 


54 


67 


84 




94 


50. beautiful 




10 


62 


70 


86 


94 


96 
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In this way, Buckingham has provided a basis of com- 
parison, which may be used by any teacher, as a method 
of testing the relative ability of different classes.' 

DIRECTIONS FOR ADMINISTERING 
The following instructions, which are essentially the 
same as those followed by Buckingham, may be given as 
regards the conduct of the test : 

(1) Give all the words in sentences during one session, 
i.e. either in morning or afternoon of same day, except 
in classes below the fifth grade, where the material should 
be given in two periods separated by half an hour at least. 

(2) Each sentence should be dictated, either as a whole 
or in part, as many times as may seem necessary to secure 
its complete understanding. This experiment is purely a 
test in spelling ; it is not expected that the pupils should 
be subjected to the added difficulty of recalling the words 
dictated. 

(3) Offer no explanation of separate words or sentences. 
If the meaning is not clear, repeat the sentence as a whole 
or in part. 

(4) Do not ask the children to underline words, or 
otherwise call attention to the significant words of the 
sentences. 

(5) After the children have written the sentences, read 
them again, and allow the pupils to insert words or make 
other corrections before finally collecting the papers. 

These papers may now be collected for the whole class, 
and the percentage of pupils getting any particular word 
correct determined and compared with the table which 
has already been given. Of course no particular signifi- 
cance is attached to any single word ; there is no one 
word which will test the spelling ability of a group. 

' The tables in this section are reproduced by the courtesy of Dr. 
B. R. Buckingham. 




' "When, however, 50 words are taken, which have been pre- 
viously standardized, the manner in which these are 
spelled by any group of pupils will serve to give a quan- 
titative idea of their spelling ability. Thus, if it is found 
by a teacher who is dealing with Grade V, that her aver- 
se percentage for 50 words falls notably below the aver- 
age given in the table for Grade V, there is every reason 
to suppose that there is something abnormal about the 
standing of that class, due to causes which might profit- 
ably be investigated. 

Suppose, for example, that we are dealing with a fifth 
grade which contains 50 children, and we find that the 
word another is spelled correctly by 31 of the children. 
Reducing this to the percentage basis, the score of the 
class for this word is 62%. On reference to Bucking- 
ham's Table, we see that the average score of this grade 
for the word another is 78%, which means that the par- 
ticular grade in question, as far as this word is concerned, 
was not equal to the average. The same procedure may 
be repeated with any of the other words in the list, and 
the average of all the percentages obtained. This figure 
may then be compared with the averages of the percentage 
for Grade V given for the particular words employed. It 
is necessary to use from 10 to 20 words in testing a grade, 
in order to avoid the danger of picking out one or two 
words upon which special drill might have been given, 
When 10 or 20 words are chosen at random from the list, 
this difficulty is obviated. 

It may appear that some justification is required for 
this laborious study. The ordinary individual would be 
apt to take the attitude that the teacher's judgment would 
be just about as sound as the estimates arrived at by 
the foregoing process. As a matter of fact, the 50 words 
were ranked by 300 judges, most of them teachers. 
Naturally there was a general agreement between the 
teachers' judgments, and the relative order of the words 
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found as the result of experimental study. But with 
certain words, there was very great disagreement. Thus, 
the word nor when ranked by the teachers was given 
fifth place as regards ease of spelling. The actual records 
show that the children found it the sixteenth word as re- 
gards ease of spelling. Again, the word button was ranked 
ninth by the teachers, and thirty-first by the records 
which came from the pupils. This shows the unsatis- 
faetoriness of relying on teachers' judgments. As long 
as those who are teaching do not know the relative diffi- 
culty of the words taught, how can they be expected to 
give the correct weight either in time or emphasis in their 
teaching? 

Buckingham, in the latter half of his study, proceeds to 
construct a scale for the measurement of spelling effi- 
ciency, a scale which contains at one end words which, 
if they cannot be spelled, would indicate zero ability, 
and at the other end words which are very difficult for 
the average child in the grades to spell. By simple statis- 
tical methods and suitable assumptions he determined 
the interval between the words on the scale, the length 
of the interval being measured by the increase in diffi- 
culty as shown by the percentage of times it Wcts correctly 
spelled. It would be impossible in the limits of this book 
to explain the method of derivation of the scale. Its 
interest is largely theoretical, and in its present form 
it could not be used with profit by the average teacher. 
It should, however, be borne in mind that such a measur- 
ing rod has been constructed even in a difficult function 
such as spelling. 




A second method of measuring spelling ability has been 
devised by Starch, who worked quite independently of 
Buckingham. While this method lacks the statistical 
precision of Buckingham's study, in that it assimies (as 
far as the score is concerned) each word to be of equal 
difficulty, it is very straightforward and has many points 
to recommend its use in the classroom. The first object 
of the experiment was to obtain six lists of equal diffi- 
culty, each containing 100 words, representative of the 
entire non-scientific English vocabulary. This was ac- 
complished by taking at random the first defined word of 
more than two letters on every even-numbered page in 
Webster's New Internationa! Dictionary. This made a 
total of 1,186 words. Every technical, psychological and 
obsolete word was then discarded, leaving 600 words. 
These were then arranged alphabetically in the order of 
size beginning with three-letter words, four-letter words, 
etc. This list was then divided into six lists of 100 words 
each, by choosing for the first list, the first, seventh, 
thirteenth, etc., word of the original list of 600 words. 
The second list was obtained in a similar manner by tak- 
ing the second, eighth, and fourteenth word, etc, ; and 
so on till the sixth list, which was formed by taking the 
sixth and twelfth word, and so on. The lists which re- 
sulted from this process are as follows : 
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LIST I 






1. 


add 


35. 


prism 


69. 


commence 


2. 


but 


36. 


rogue 


70. 


estimate 


3. 


get 


37. 


shape 


71. 


flourish 


4. 


low 


38. 


steal 


■ 72. 


luckless 


5. 


rat 


39. 


swain 


73. 


national 


6. 


sun 


40. 


title 


74. 


pinnacle 


7. 


alum 


41. 


wheat 


75. 


reducent 


8. 


blow 


42. 


accrue 


76. 


standing 


9. 


cart 


43. 


bottom 


77. 


venturer 


10. 


cone 


44. 


chapel 


78. 


ascension 


11. 


easy 


45. 


dragon 


79. 


dishallow 


12. 


feU 


46. 


filter 


80. 


imposture 


13. 


foul 


47. 


hearse 


81. 


invective 


14. 


gold 


48. 


laden 


82. 


rebellion 


15. 


head 


49. 


milden 


83. 


scrimping 


16. 


ki.sfl 


50. 


pilfer 


84. 


unalloyed 


17. 


long 


51. 


rabbit 


85. 


volunteer 


18. 


mock 


52. 


school 


86. 


cardinally 


19. 


neck 


53. 


shroud 


87. 


connective 


20. 


rest 


54. 


starch 


88. 


effrontery 


21. 


spiir 


55. 


vanity 


89. 


indistinct 


22. 


then 


56. 


bizarre 


90. 


nunciature 


23. 


vile 


57. 


compose 


91. 


sphericity 


24. 


afoot 


58. 


dismiss 


92. 


attenuation 


25. 


black 


59. 


faction 


93. 


fulminating 


26. 


brush 


60. 


hemlock 


94. 


lamentation 


27. 


dose 


61. 


leopard 


95. 


secretarial 


28. 


dodge 


62. 


omnibus 


96. 


apparitional 


29. 


faint 


63. 


procure 


97. 


intermissive 


30. 


force 


64. 


rinsing 


98. 


subjectively 


31. 


grape 


65. 


splashy 


99. 


inspirational 


32. 


honor 


66. 


torpedo 


100. 


ineffectuality 


33. 


mince 


67. 


worship 






34. 


paint 


68. 


bescreen 
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LIST 11 






Ki 


air 


35. 


quill 


69. 


covenant 


^P& 


cat 


36. 


rough 


70. 


eugenics 


^^ 8. 


hc^ 


37. 


shout 


71. 


friskful 


4. 


man 


38. 


stick 


72. 


luminous 


5. 


row 


39. 


swear 


73. 


opulence 


6. 


tap 


40. 


trump 


74. 


planchet 


7. 


awry 


41. 


whirl 


75. 


reformer 


8. 


blue 


42. 


action 


76. 


thorough 


9. 


cast 


43. 


bridle 


77. 


watering 


10. 


corn 


44. 


charge 


78. 


belonging 


11. 


envy 


45. 


driver 


79. 


displayed \ 


12. 


feud 


46. 


finger 


80. 


indention 


13. 


game 


47. 


heaven 


81. 


mercenary 


14. 


grow 


48. 


legend 


82. 


redevelop 


15. 


home 


49. 


motley 


83. 


senescent 


16. 


knee 


50. 


portal 


84. 


uncharged 


17. 


look 


51. 


recipe 


85. 


whichever 


18. 


mold 


52. 


scrape 


86. 


centennial 


19. 


part 


53. 


simple 


87. 


constitute 


20. 


ruin 


54. 


strain 


88. 


exaltation 


21. 


take 


55. 


weaken 


89. 


in vocative 


22. 


tree 


56. 


breaker 


90. 


personable 


23. 


well 


67. 


congeal 


91. 


strawberry 


24. 


allay 


58. 


disturb 


92. 


concentrate 


25. 


blaze 


59. 


foreign 


93. 


imaginative 


26. 


buggy 


60. 


hoggery 


94. 


mathematics 


27. 


clown 


61. 


meaning 


95. 


selfishness 


28. 


doubt 


62. 


onerate 


96. 


collectivity 


29. 


false 


63. 


provoke 


97. 


marriageable 


30. 


forth 


64. 


salient 


98. 


agriculturist 


31. 


grass 


65. 


station 


99. 


quarantinable 


32. 


house 


66. 


trample 


100. 


relinquishment 


33. 


money 


67. 


abstract 




g^J 


84. 


paper 


68. 


bulletin 




J 
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LIST III 




« 


; 1. art 


35. 


razor 


69. 


doQunate ■ 


1 2. dry 


36. 


saint 


70. 


exchange m 


^H 


37. 


smell 


71. 


governor 1 


^^1 


38. 


stock 


72. 


manifest il 


^^f 5. nm 


39. 


swoop 


73. 


osculate • J 


^^ 6. top 


40. 


twine 


74. 


pleasure 


7. back 


41. 


white 


75. 


revising 


8. bond 


42. 


barrel 


76. 


traverse 


9. chip 


43. 


buckle 


77. 


westward 


10. crib 


44. 


cotton 


78. 


capitally 


11. ever 


45. 


engine 


79. 


extremism 


12. Are 


46. 


flimsy 


80. 


indicated 


13. gilt 


47. 


helmet 


81. 


monoplane 


14. liaclc 


48. 


lesser 


82. 


repertory- 


15. himt 


49. 


ocular 


83. 


stimulate 


16. lace 


50. 


potato 


84. 


unlocated 


17. main 


51. 


relate 


85. 


accidental 


IS. more 


52. 


season 


86. 


citizenize 


19. pelt 


53. 


single 


87. 


contribute 


20. sand 


54. 


supply 


88. 


expertness 


21. tang 


55. 


weight 


89. 


locomotive 


22. turn 


56. 


captain 


90. 


prevailing 


23. wine 


57. 


contour 


91. 


symmetrize 


24. amuse 


58. 


earnest 


92. 


consolatory 


25. blind 


59. 


fowling 


93. 


incremental 


26. catch 


60. 


inflate 


94. 


penetrative 


27. count 


61. 


measure 


95. 


superintend 


28. dress 


62. 


palaver 


96. 


conterminoiiB 


29. fancy 


63. 


raising 


97. 


naturalistic 


SO. freak 


64. 


seizing 


98. 


artificiality 


31. gross 


65. 


sulphur 


99. 


re-examination 


32. inlet 


66. 


trestle 


100. 




33. muddy 


67. 


adhesive 




J 


34. peace 


68. 


buttress 
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LIST rv 






^Kl.),ee 


36. 


remit 


69. 


enabling 


^■•2. elk 


36. 


scale 


70. 


external 


3. key 


37. 


speak 


71. 


greeting 


4. new 


38. 


stone 


72. 


mosquito 


5. saw 


39. 


thick 


73. 


outfiing 


6. war 


40. 


under 


74. 


positive 


7. base 


41. 


widen 


75. 


romantic 


8. book 


42. 


Ijearer 


76. 


undulate 


9. clue 


43. 


canine 


77. 


adverbial 


10. down 


44. 


create 


78. 


carpentry 


11. tall 


45. 


eraser 


79. 


franchise 


12. flat 


4G. 


garret 


80. 


mfatuate 


13. girt 


47. 


hollow 


81. 


promenade 


14. hand 


48. 


little 


82. 


rigmarole 


15. iron 


49. 


ofiice 


83. 


stripling 


16. lime 


50. 


prince 


84. 


vegetable 


17. make 


51. 


retain 


85. 


assignment 


18. move 


52. 


settle 


86. 


comparison 


19. plug 


53. 


sluice 


87. 


coordinate 


20. shop 


54. 


swerve 


88. 


expressage 


21. tear 


55. 


withal 


89. 


mayonnaise 


22. tusk 


56. 


chicken 


90. 


recompense 


23. wire 


57. 


counter 


91. 


untraveled 


24. apple 


58. 


emperor 


92. 


consumptive 


25. blood 


59. 


freight 


93. 


infuriation 


26. chain 


60. 


journal 


94. 


photosphere 


27. craft 


61. 


neglect 


95. 


terrestrial 


28. drawn 


62. 


pa^ion 


96. 


horsemanship 


29. field 


63. 


reserve 


97. 


regenerative 


30. frost 


64. 


serpent 


98. 


eu'cumscribed 


31. guard 


65. 


surface 


99. 


sculpturesque 


^^ 32. jelly 


66. 


trouble 


100. 


verisimilitude ^^^ 


^^L 83. ocean 


67. 


affected 




^^^^M 


^^84. pitch 


68. 


calendar 




1 
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1. bow 

2. fly 
8. law 
4. old 

O* SGG 

6. ax^he 

7. bead 

8. call 

9. cold 

10. draw 

11. fast 

12. foU 

13. glue 

14. hard 

15. jack 

16. line 

17. mark 

18. musk 

19. prig 

20. slat 

21. test 

22. vend 

23. wood 

24. armor 

25. boast 

26. chase 

27. cross 

28. enjoy 

29. fixed 

30. glean 

31. guild 

32. joint 

33. order 

34. point 



LIST V 

35. revel 69. 

36. scorn 70. 

37. spire 71. 

38. strut 72. 

39. three 73. 

40. voice 74. 

41. wince 75. 

42. beaver 76. 

43. cannon 77. 

44. crispy 78. 

45. escape 79. 

46. gladly 80. 

47. hustle 81. 

48. mallet 82. 

49. oriole 83. 

50. pulley 84. 

51. rubric 85. 

52. shears 86. 

53. solace 87. 

54. trifle 88. 

55. yellow 89. 

56. circuit 90. 

57. crooked 91t 

58. enstamp 92. 

59. general 93. 

60. lateral 94. 

61. nourish 95. 

62. placard 96. 

63. resolve 97. 

64. signify 98. 

65. tabloid 99. 

66. unitive 100. 

67. approved 

68. cerebral 



entirely 

farewell 

incident 

mountain 

parallel 

prelimit 

spectral 

urbanize 

aggrieved 

clarifier 

hydraulic 

inheritor 

purgation 

sacrifice 

surviving 

vestibule 

authorship 

concoction 

derigation 

federative 

memorandum 

regularity 

abnormality 

disseminate 

insensitive 

predominate 

unprevented 

inarticulate 

stupendously 

communicating 

anthropometric 

emancipationist 
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LIST VI 








1. 


bos 


35. 


river 


69. 


erosible 




2. 


gap 


36. 


shaft 


70. 


fetching 




3. 


lay 


37. 


stall 


71. 


juncture 




4. 


pod 


38. 


sugar 


72. 


narcotic 




5. 


sex 


39. 


throw 


73. 


parasite 




6. 


alms 


40. 


watch 


74. 


probator 




7. 


bird 


41. 


young 


75. 


squeaker 




8. 


camp 


42. 


begird 


76. 


vagabond 




9. 


comb 


43. 


causal 


77. 


amphibian 




10. 


dusk 


44. 


discus 


78. 


clearness 




11. 


fear 


45. 


ferret 


79. 


impatient 




12. 


foot 


46. 


gutter 


80. 


intestine 




13. 


goat 


47. 


killed 


81. 


quadruple 




14. 


hawk 


48. 


middle 


82. 


sauciness 




15. 


keep 


49. 


paddle 


83. 


ticketing 




16. 


lite 


50. 


puzzle 


84. 


virulence 




17. 


mass 


51. 


sample 


85. 


bafflement 




18. 


navy 


52. 


shield 


86. 


condescend 




19. 


raft 


53. 


spring 


87. 


disconcert 




20. 


some 


54. 


tubule 


88. 


illiterate 




21. 


that 


55. 


bicycle 


89. 


metropolis 


■ 


1 22. 


vice 


66. 


commode 


90. 


repression 


■ 


1 23. 


work 


57. 


discard 


92. 


animaleular 


■ 


r 24. 


aside 


58. 


exeuser 


92. 


divestiture 




25. 


brawn 


59. 


gravity 


93. 


intrinsical 




26. 


chime 


60. 


leaping 


94. 


prerogative 




27. 


crown 


61. 


obloquy 


95. 


upholsterer 




28. 


equip 


62. 


pontiff 


96. 


interference 




29. 


flock 


63. 


retreat 


97. 


subantaretic 




30. 


grand 


64. 


society 


98. 


convocational 




31. 


hedge 


65. 


tigress 


99. 


imperturbation 




32. 


knock 


66. 


vitiate 


100. 


irresponsibility 


1 


33. 


ought 


67. 


auditory 






■ 


KS4. 


poppy 


68. 


churlish 








■ Then ■cales 


are reproduced by the courtesy of 


Dr. Daniel Starch. 
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The advantages of this method of selection are : (1) It 
gives a random sampling of the entire non-technical Eng- 
lish vocabulary, for easy words and very hard words 
occur in the same proportion in the lists as in the English 
language. (2) The list contains words sufficiently easy 
to test the poorest speller. (3) The essential requirement 
of every scientific experiment is fulfilled, since another 
600 words of the same average difliculty can be chosen, 
by employing the same method of selection, e.g. the tenth 
word in the dictionary could be used in place of the first 
word. 



DIRECTIONS FOR ADMINISTERING TESTS 

First have the pupils write the name, grade, school, 
city and date at the top of the sheet. 

Pronounce the words clearly, but do not sound them 
phonetically, or inflect them so as to aid the pupils. Give 
the meaning of words that sound like words with a dif- 
ferent meaning and spelling. The pupils are to write the 
words and to number them in the order in which they are 
given. Allow sufficient time for the writing. 

Each grade is to be tested twice on two successive days. 
Use any one of the six lists on the first day and a different 
list on the second day. (When an entire school is being 
tested it may be desirable, though not necessary, to use 
on the first day the same list, say List 1, in all grades, and 
any other list on the second day.) 

In the first grade use the first 40 words of the list, in 
the second grade use the first 65 words, in the third grade 
use the first 80 words, in the fourth grade use the first 90 
words, and in all other grades use the entire list. 

It has been demonstrated by administering the lists in 
schools, that each of them is of approximately the same 
difficulty. It is perhaps desirable, however, when meas- 
uring the efficiency of an individual group, to give two 
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of the tests. The average of the score made in the two 
tests will represent pretty accurately the spelling ability. 

STANDARDS OF EFFICIENCY IN SPELLING 
These spelling tests have been standardized by admin- 
istering them to 2500 pupils in 12 schools of 5 cities, 
located in Wisconsin, Minnesota, and New York. The 
average results obtained are shown in the table below, in 
which the scores are given in round figures. 

Standasd Scores for Sfblung 
Grades ...1 2 3 4 5 6 7 8 

10 30 40 51 61 71 78 85 

This table shows that on the average in Grade III in 
the schools measured, 40% of each list was spelled cor- 
rectly. The point of most importance for the individual 
teacher is to know how the pupils of a particular grade 
compare in spelling efficiency with pupils of the same 
grade of other schools. 

By using this very simple device, a purely objective meas- 
ure of spelling ability can be obtained by the ordinary 
teacher. No longer need we speak of "good spellers," 
"bad spellers" and "medium spellers"; we can assign a 
numerical value to the spelling ability of each individual. 

m. THE AYRES SPELLING TEST (looo WORDS) ' 
Ayres has also presented a further method of measur- 
ing spelling ability based on the one thousand most com- 
mon words in the English language. These words were 
chosen by combining the results of four previous investiga- 
tions which had as their object the selection of the words 
most commonly used in different sorts of writing. The 
first study was founded on passages from the Bible and 
other well-known writings, including in all about 100,000 
' The Ayres Spelling Scale (see insert) is reproduced by the courtesy 
ol Dr. Leonard P. Ayres. 
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words. The second study of the frequency of different 
words was made on the basis of an analysis of the words 
used in 250 different articles taken from issues of four 
Sunday newspapers published in Buffalo. These articles, 
counting repetitions, contained 43,989 words; without 
repetitions, 6000 words. The third study consisted of 
the tabulation of 23,629 words from 2000 short lettera 
written by 2000 people. The last study comprised a 
tabulation of some 200,000 words taken from the family 
correspondence of thirteen adults, 

The list of 1000 words finally selected was determined 
by combining the results of all these studies. Thus, the 
1000 words chosen were those which occurred most fre- 
quently in passages selected from a wide variety of 
sources ; namely, the Bible, the writings of famous 
authors, newspaper articles, and private correspondence. 

The method employed in standardizing the difficulty 
of each of the 1000 words was essentially the same as that 
used by Buckingham, but on a more extensive scale. 
The 1000 words were first made into 50 lists of 20 words 
each, and these lists were then administered, m the middle 
of the school year, to various grades in the schools of 84 
cities scattered throughout the United States. The data 
secured from these tests made an aggregate of 1,400,000 
spellings by 70,000 children. It was on the basis of this 
data that the Ayres Scale was constructed. 

The scale presented explains itself. All the words in 
any particular column are of approximately the same 
spelling difficulty, the difficulty of each word having been 
determined by the percentage of times the word was 
spelled correctly in the tests mentioned above. 

DIRECTIONS FOR ADMINISTERING 

The details for administering the tests v^U be clear from 

the following example. Suppose we wished to measure 
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the spelling ability of any fifth grade. Taking any one 
of the columns given in the scale — say Column — we 
would first of all select any twenty words from it. Then 
we would dictate these words in a list to the class, giving 
ample time for each word and explaining the meaning of 
a word, if doubtful, by putting it in a sentence. Lastly, 
we would collect the papers and calculate the number of 
words spelled correctly. If there were 30 children in the 
class, that would mean that 600 spellings were performed. 
Suppose out of these 600 spellings there were 480 correct. 
Then 80% of the words would be correctly spelled. A 
reference to the scale, Column 0, shows that the fifth 
grade average at midyear is 84%, and the fourth grade 
average, 73%. Therefore the class measured would be 
a little below the average fifth grade standing. Suppose 
a particular child in the grade gets 18 correct out of the 
20 words. This means a score of 90%, or slightly below 
the average for the sixth grade, which is 92%. The only 
care that must be taken in administering the test is not 
to select a list of words so short that there is a chance of 
not obtaining representative results. For this reason, in 
testing the ability of a particular pupil it is well not to 
iise less than 20 words ; but if a group is being tested, so 
as to obtain merely the group average, a smaller number 
of words may be used. 

It should be noted that the standards published with 
the Ayres Scale only apply where these words have been 
given to pupils who have had no especial drill on them. 
For, smce the words in the scale are so common that 
they form an excellent foundation for spelling, it is 
reasonable to suppose that special attention will be 
given them. This drill will make the pupil too familiar 
with them to have his score judged by the standard 
score as obtained by Ayres. This means that probably 
h will be necefigary for each school to establish its own 
standards. ■ ' 




1. Select 16 words from ttie Buckingham Scale and use these for 
meaBUrirg the spelling ability of a particular dasa. Outline the atepg 
you would take, and the way in which you would administer the test, 
score the papers, and tabulate the results. 

2. What are the advantages derived from knowing the relative 
diJBculties of different words? How should this alter the method of 
teaching ? 

3. Using the Starch Scale, how would you establish norms for the 
grades of your own school? Is it fair to expect a foreign district 
school and an English-speaking district school to produce the same 
percentages? 

4. Suppose a teacher took any list of 100 words and administered 
these to a grade and discovered that on the average 75% of the spell- 
ings were correct, what would this tell or fail to tell the teacher? 

5. If it was found that the average scores of a grade V, for suc- 
cessive years, tested in January on the Starch Scale, were 59, 60, 61, 
62, 60, and the average fell suddenly to 53, where would you look for 
the cause? 

6. How, by means of these scales, would it be possible to compare 
two different methods of teaching spelling? 

7. If it is found that some children are very much better than the 
average for their grades, how should this affect the amount of time 
they devote to spelling? What should be done for those who are 
much poorer than the average? 

8. Use (a) the Buckingham Scale, (6) the Ayres Scale, (e) the 
Starch Scale, to test the same class on successive days. Do the re- 
sults agree, in that they show that the class has the same ability, 
measured by the grade norms? 

9. Why would it not be fair to apply any of these tests if the 
children had been drilled on the lists used in these tests? Which is 
the safest scale to use if we wish to eliminate this error? 

10. Administer List 1 and List 2 of the Starch Scale to the same 
class, on successive days, and compare the average scores in each. 
Should they be the same? Why? 
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CHAPTER VI 

COMPOSITION SCALES 

I. HILLEGAS SCALE 
n. HARVAHD-NEWTOH SCALES 

The task of evaluating efficiency in composition is 
obviously a complex one because, not only are there 
several distinct types of composition, such as narration, 
description, etc., but merit in each of these types is the 
resultant of many independent factors. Attempts to esti- 
mate this efficiency — the qualities desirable in English 
composition — have resulted in the production of three 
separate methods of measuring. 

The first method is that of the Hillegas Scale of mixed 
types of composition. This scale consists of a number of 
samples of English composition representing various types 
and ranging from very good to very poor in quality, each 
grade in the scale being represented by but one composi- 
tion. For example, the sample composition representing 
one grade may be of the narration type, while that repre- 
senting another grade may be of the description type. 
Since the composition to be measured is compared directly 
with the compositions in the scale, as in the Thomdike 
Handwriting Scale, the accurate comparison of one style 
of composition with an entirely different style, as is often 
necessary, is exceedingly difficult. 

It was to do away with this objection that the second 
method of measurement, namely, the Harvard-Newton 
series of four scales, was formed. These scales measure 
efficiency in description, narration, exposition and argu- 
mentation, respectively. 

131 
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Thirdly, there is the metiiod originated by Rice and 
used with apparent success by Bliss and Courtis. Here 
no attempt is made to construct an actual scale; but 
progress in composition writing in an individual, class, or 
school is determined by simply noting the improvement 
shown by the individual, class, or school, in successive 
reproductions of similar selections at intervals through- 
out the school year. No attempt is made to express the 
value of the composition in per cents or otherwise. It is 
simply read, and placed in the class " Excellent," " Good," 
" Poor," etc., on the basis of the general impression pro- 
duced by reading it. These initial attempts are so lacking 
in the precision for which the whole movement for stand- 
ardization of school products stands, that they need no 
further description. 

I. HILLEGAS COMPOSITION SCALE 

The "Hillegas Scale for the Measurement of Quality 
in English Composition by Young People" consists of 
ten sample compositions which have been arranged in 
order of increasing merit, merit meaning that quality 
which competent persons consider as such. These samples 
have been assigned the following values : 0, 18, 26, 37, 
47, 58, 67, 77, 83, and 93, respectively. These values are 
not based on the ordinary percentage system used in 
grading and should not be confused with such per cents. 
Instead, each one of the values represents the number of 
units of quality possessed by the composition to which it 
is attached. Thus, the composition rated 93 is approxi- 
mately twice as good as the one rated 47, while the one 
rated 18 is approximately half as good as the one rated 37. 
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Dear Sir : I write to say that it aint a square deal Schools 
is I say they is I went to a school, red and gree green and 
brown aint it hito bit I say he don't know his business not 
today nor yesterday and you know it and I want Jennie to 
get me out. 

18 

the book I refer to reach is Ichabod Crane, it is an grate 
book and I like to rede it. Ichabod Crame was a man and 
a man wrote a book and it is called Ichabod Crane i like it 
because the man called it ichabod crane when I read it for it 
is such a great book. 



26 

Advantage evils are things of tjn-anny and there are many 
advantage evils. One thing is that when they opress the 
people they suffer awful I think it is a terriable thing when 
they say that you can be hanged down or trodden down 
without mercy and the tjn-anny does what they want there 
was tjn-ans in the revolutionary war and so the throwed off 
the yok. 

37 

Sulla as a Tjn-ant 

When Sulla came back from his conquest Marius had put 
himself consul so sulla with the army he had with him in his 
conquest seized the government for Marius and put himself 
in consul and had a list of his enemys printy and the men 
whoes names were on this list we beheaded. 
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47 

De Qtiincy 

First: De Quincys mother was a beautiful woman and 
through her De Quincy inhereted much of his genius. 
His running away from school enfluenced him much as he 
roamed through the woods, valleys and his mind became very 
meditative. 

The greatest enfluence of De Quincy's life was the opitmi 
habit. If it was not for this habit it is doubtful whether 
we would now be reading his writings. 

His companions during his college course and even before 
that time were great enfluences. The surroundings of De 
Quincy were enfluences. Not only De Quincy's habit of 
opiimi but other habits which were peculiar to his life. 

His marriage to the woman which he did not especially 
care for. 

The many well educated and noteworthy friends of De 

Quincy. 

68 

Pluellen 

The passages given show the following characteristic of 
Pluellen : his inclination to brag, his professed knowledge of 
History, his complaining character, his great patriotism, 
pride of his leader, admired honesty, revengeful, love of ftm 
and punishment of those who deserve it. 

67 

Ichabod Crane 

Ichabod Crane was a schoolmaster in a place called Sleepy 
Hollow. He was tall and slim with broad shoulders, long 
arms that dangled far below his coat sleeves. His feet 
looked as if they might easily have been used for shovels. 
His nose was long and his entire frame was most looely htmg 
to-gether. 



Composition Scales 



Going Down with Victory 

As we road down Lombard Street, we saw flags waving 
from nearly every window. I surely felt proud that day to 
be the driver of the gaily decorated coach. Again and again 
we were cheered as we drove slowly to the postmasters, to 
await the coming of his majestie's mail. There wasn't one 
of the gaily bedecked coaches that could have compared 
with ours, in iny estimation. So with waving flags and 
fluttering hearts we waited for the coming of the mail and the 
expected tidings of victory. 

When at last it did arrive the postmaster began to quickly 
sort the bundles, we waited anxiously. Immediately upon 
receiving our bundles, I lashed the horses and they responded 
with a jump. Out into the coimtry we drove at reckless 
speed — everywhere spreading like wUdfire the news, "Vic- 
tory!" The exileration that we all felt was shared with 
the horses. Up and down grade and over bridges, we drove 
at breakneck speed and spreading the news at every hamlet 
with that one cry "Victory !" When at last we were back 
home again, it was with the hope that we should have an- 
other ride some day with "Victory." 
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Venus of Melos 

In looking at this statute we think, not of wisdom, or 
power, or force, but just of beauty. She stands resting the 
weight of her body on one foot, and advancing the other {left) 
with knee bent. The posture causes the figure to swav 
slightly to one side, describing a fine curved line. The 
lower limbs are draped but the upper part of the body is un- 
covered. (The imfortunate loss of the statute's arms pre- 
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vents a positive knowledge of its original attitude). The 
eyes are partly closed, having something of a dreamy lan- 
gotir. The nose is perfectly cut, the mouth and chin are 
moulded in adorable curves. Yet to say that every feature 
is of faultless perfection is but cold praise. No analysis can 
convey the sense of her peerless beauty. 

93 

A Foreigner's Tribute to Joan of Arc 

Joan of Arc, worn out by the suffering that was thrust 
upon her, nethertheless appeared with a brave mien before 
the Bishop of Beauvais. She knew, had always known that 
she must die when her mission was fulfilled and death held 
no terrors for her. To all the bishop's questions she answered 
firmly and without hesitation. The bishop failed to confuse 
her for heresy, bidding her recant if she would live. She 
refused and was lead to prison, from there to death. 

While the flames were writhing around her she bade the 
old bishop who stood by her to move away or he would be 
injtired. Her last thought was of others and De Quincy 
says, that recant was no more in her mind than on her lips. 
She died as she lived, with a prayer on her lips, and listening 
to the voices that had whispered to her so often. 

The heroism of Joan of Arc was wonderful. We do not 
know what form her great patriotism took or how far it 
really led her. She spoke of hearing voices and seeing visions. 
We only know that she resolved to save her country, know- 
ing though she did so, it would cost her her life. Yet she 
never hesitated. She was uneducated save for the lessons 
taught her by nature. Yet she led armies and crowned the 
dauphin, king of France. She was only a girl, yet she could 
silence a great bishop by words that came from her heart 
and from her faith. She was only a woman, yet she could 
die as bravely as any martjn: who had gone before. 

This scale is reproduced by the courtesy of Dr. M. B. Hillegas. 



The scale was derived in the following manner. The 
first step taken was the collection from various sources of 
about 7000 English compositions ranging from the very 
poorest to the best work done in the elementary and high 
schools. After these compositions had each been given 
a number from 1 to 7000, they were roughly graded by 
Hillegas and an assistant into ten classes, and from these 
ten classes 75 samples were selected. In order to have 
samples at both extremes of the scale, some artificial ones 
were supplied. Those placed at the zero end of the scale 
were conscious efforts by adults to write very poor Eng- 
lish, while those placed at the one hundred end were 
obtained from youthful writings of certain literary geniuses 
and from the work of some college freshmen. As aug- 
mented, the set consisted of 83 samples varying from the 
poorest to the best by small degrees of quality. That 
the character of the handwriting might not influence the 
judges, all the samples were tj^iewritten and mimeo- 
graphed. 

Separate sets of these samples were then sent to about 
100 individuals, who were asked to arrange the samples 
in the order of their merit as specimens of English com- 
position, calling the poorest specimen No. 1, the next. 
No. 2, and so on. Owing to the small number of judg- 
ments it was not possible to establish the position of any 
one sample with reasonable accuracy, but those samples 
that were of about equal merit were indicated. This re- 
sulted in the selection of a smaller set which still con- 
tained all the important steps in quality from the worst 
to the best. 

This smaller set, comprising 27 samples, was selected 
by taking successively each of the samples in the larger 
group that about 75% of the judges bad agreed was 
better than the last one selected. This percentage of 
judgments was taken for statistical reasons which will be 
explmned later. Where large differences in m«it existed 
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between two successive samples, new samples, judged by 
a number of individuals as ranging in merit between 
them, were introduced. 

Then, as with the first set of samples, more than 100 of 
these sets consisting of 27 samples were mailed to com- 
petent critics of English literature, such as teachers, 
authors, and literary workers, with the request to rank 
them in order of literary merit. When 75 replies had 
been received, the results were tabulated as in the case 
of the first set. Meantime, the judgments of 41 indi- 
viduals especially competent to judge merit in English 
composition writing were secured to use as a check on 
the others. The examination of the results from this 
second set showed the necessity of adding two more 
samples to the set. This was done, making 29 samples 
in all. 

After one or the other of the two sets, to which 21 of 
the samples were conamon, had been judged by about 
200 individuals, it was decided to make the scale. The 
first thing necessary was to locate a zero point. This 
point was to be represented by a sample which possessed 
absolutely no merit as an English composition. It was 
chosen on the basis of the judgments of 28 qualified indi- 
viduals. When the result of these judgments was tabu- 
lated, it was found that just one-half of them considered 
such a point as below sample 580 and one-half as above 
it, and so sample 580 was taken as the zero point on the 
scale. 

The ten samples chosen for the scale were selected on 
the principle of equally often noticed differences, which 
Is as follows : Differences that are equally often noticed 
are equal {unless always or never noticed). Thus, if in 
a set of samples, a, b, c, d, etc., it was found that a was 
judged better than b, just as often as 6 was judged better 
than c, and so on, samples a, b, c, d, etc., would constitute 
a scale of equal steps. To put the case more concretely, 



if in an essay contest, essay A was judged better than 
essay B in 75% of the judgments, essay B was judged 
better than essay C in the same number of judgments, 
and so on, it is readily seen that the differences in quality 
between essays A, B, C, etc., are equal because the same 
number of individuals noticed this difference. Similarly, 
as a resuJt of all the comparisons made of the sample 
compositions, the result was approximately as follows : 

Sample 18 was judged better than sample in 75% of 
the judgments. 

Sample 26 was judged better than sample 18 in 75% of 
the judgments. 

Sample 37 was judged better than sample 26 in 75% of 
the judgments, and so on for samples 47, 58 and 94. 

Thus in samples 18, 26, 37, etc., we have the successive 
steps of a scale, steps that are equal inasmuch as they 
represent differences that are equally often noticed. 

Why the opinion of 75% of the judges was taken as 
the unit of value, instead of some other per cent, may 
probably be better understood if the following case is 
considered. If, hi comparing the ability of two states- 
men, say Gladstone and Bismarck, 50% of the judges 
claim Gladstone to have possessed the greater ability, 
while 50% claim the same for Bismarck, it may safely be 
assumed that they possessed about equal ability. If, 
however, 60% of the judges believe Gladstone to have 
been the more efficient, the chances are that Gladstone 
was probably slightly more capable than Bismarck. As 
the percentage of judgments favoring Gladstone increases, 
the chances are shown to be greater that Gladstone had 
the superior ability, and when 100% of the judges believe 
him to have surpassed Bismarck it may safely be assumed 
that such was actually the case. Similarly, in the present 
case if 75% of the judges say that a given sample is 
better than another given sample, we may be reasonably 
sure that such is the case. 
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The value of any English composition may be obtained 
by placing it alongside the samples in the scale and decid- 
ing which it is most nearly like in quality. By having 
other judges measure it, each being in ignorance of the 
judgment of the others, or, if this is not practicable, by 
rating the sample two or three times, a very accurate 
measure of it may be secured. For example, if the com- 
position seems to be very similar in quality to sample 77, 
then it is marked 77. If it seems to lie between samples 
77 and 83, it should be given a value between 77 and 83, 
as 79 or 81, according to which sample the specimen more 
nearly resembles. 

n. HARVAED-NEWTON SCALES 
An experiment with the Hillegas Scale in the public 
schools of Newton, Massachusetts, led the school authori- 
ties of that city to believe that it possessed several in- 
herent defects. They maintained that since the scale 
provides one, and only one, type of composition for each 
one of the grades, the type of one grade differing entirely 
from that of the next (that is, grade A in the scale is 
represented by one type of composition, grade B, by an- 
other, and so on), it was difficult or impossible to com- 
pare the work of one type of composition, narration, for 
example, with that of another type, like description. 
Moreover, they claimed the sample compositions were 
not typical of efficient school work. An attempt to 
remedy these defects resulted in the Harvard-Newton 
series of scales, the general nature of which will be de- 
scribed before the construction of the scale is discussed 
in detail. This objective measure is the outcome prin- 
cipally of the cooperation of Ballou, and the teachers of 
the Boston and Newton public school systems. 

It consists of four separate scales to measure the four 
different forms of composition in the eighth grade ; namely, 
description, narration, argumentation, and exposition. 
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PEach scale in the series is composed of six compositions, 
I actually written by eighth grade pupils ; thus each scale 
[ possesses the same qualities that it is designed to measure. 
These sample compositions range by approximately equal 
steps from the best to the poorest work which is likely 
to be done in the eighth grade, and each of them has 
been assigned a letter and a percentage valuation in con- 
formity with the current practice in grading. "A" rep- 
resents the conventional value of 95%; "E" that of 
85%; "C"of 75%; andsoon. In this way sample "A" 
is fairly representative of all compositions whose value 
would seem to lie somewhere between 90% and 100%; 
sample "E", of all those whose value would seem to lie 
between 80% and 90%, and so on. Each sample com- 
position is accompanied with a short description of its 
merits and defects, and it is compared with the next 
higher and lower compositions in the scale. These de- 
scriptions and comparisons were written by the teachers 
who helped to make the scale and expected to use it. 
Without some such guiding material, it is doubtful 
whether those who use the scale would see the same 
merits and defects in a composition as those who made 
the scale, and, imless this was the case, little advantage 
would be derived from its use. The general nature of 
the four scales may readily be seen from the one — the 
description scale — which follows. 
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THE COMPLETED DESCRIPTION SCALE 
No. 1. "A" GRADE COMPOSITION. VALUE, 94,6% 

A Storm m a Fishing Village 

It was a cold damp day in November. The sky was a 
heavy Jeaden color. In the east a black Une stretched 
across it foretelling the coming of a storm. The houses 
across the way were dismal shadows, — flat, cold, heart- 
5 less. A piercing chill penetrated to the bone. The rattle 
of a grocer's cart or the clatter of a horse's hoofs, seemed 
cold. The pedestrians were all clothed in black, or else 
the feeble hght made them seem so, and they were cold 
^everything was cold, cold, cold. An awful lonliness 

10 pervaded all. 

The black line in the east had grown into a cloud and 
was coming nearer, nearer, over the sea. Suddenly a gust 
of wind shook the very foundations of the houses, — an- 
other, and then a continuous blowing. The howling was 

15 horrible. Great sheets of foam were blown into the 
streets, — here and there a piece of wreckage hurled itself 
against a cottage. Fishermen's wives hurried down the 
narrow streets to the shore, straining their eyes for any 
sign of a wreck. Old seamen looked at the roaring sea 

20 and shook their heads. 

By this time the black cloud had engulfed the sky. The 
day was like night, although it was not yet noon. Bo}^ 
ran about with torches which were immediately extin- 
guished, and the roaring called to mind the last day at 

25Pomi>eii, 

Rain had begun to descend. At first only drops fell 
on the hardened faces of old mariners, and on the pale 
countenances of wives, mingling with the drops already 
there. But soon great sheets fell, forcing the people m- 

30 doors, to the poor shelter afforded by the groaning houses. 
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For about an hour the storm continued thus, then by 
degrees the wind lessened, though the rain still fell, and 
the ocean thundered. But soon the rain also slowly 
stopped and the roaring ceased. The black cloud rolled 
slowly away, leaving the tardy sun to shine on the drenched 3i 
town and the great piles of wreckage on the shore. 



Merits 

This theme ranks high because the writer has a clear picture ot the 
acene and has used words and phrases that bring the details ot thia 
picture clearly before the reader. There are good color images in 
such expressions as leaden, a black line, great sheets of foam, the day 
was like night, and the sun shining on the drenched lojim. Sound effects 
are strikingly brought out by such phrases as tfte rattle of a grocer's 
earl, the bowling, the wreckage hurled against the cottage, the roaring sea, 
and the thundering ocean. The sensation of dreariness and chill is 
conveyed by the repetition of the word cold. The confusion caused 
by the Btorm is reflected in the anxious look of the wives of the fisher- 
men. A further human touch is added in the mention of such details 
as the extinguished torches carried by the boys and the drops of rain fall- 
ing u-pon the hardened faces of the old mariners. All these enumera- 
tions fittingly combine to produce a tone of coldness, desolation, and 
anxiety. The details are told in their natural sequences. This 
chronological arrangement has helped the writer to keep safely to his 
main point and effectively connect the details with each other. 



I 



L 



Defects 

The repetition of the word cold, while effective in bringing out the 
■ensation, is somewhat artificial. LoneUnees (line 9), is misspelled; 
% semicolon should supplant the comma in line 8. Omit the comma 
Inline 6. 



Comparison 

The theme is superior to No. 2 in its richness of imagery, its wealth 
of details, its depth ot feeling, its maturity of style (seen in the sen- 
tence-structure and the vocabulary), and in its mastery of mechanical 



144 Scientific Measurement 

No. 2. "B" GRADE COMPOSITION. VALUE, 83.6% 

Grandmother 

In front of the open fireplace in a large armchair there 
sits our old Granny. She is old and feeble. Her hair is 
snow-white and over her head a little white cap is care- 
fully tied. Her face is full of wrinkles and her keen blue 

5 eyes sparkle through a pair of glasses which she has on 
her nose. 

She has a shawl thrown over her shoulders and she also 
wears a thick black skirt. On her feet can be seen a pair 
of soft slippers which she prizes very much because they 

10 were given her for a Christmas present. 

As you know Grannies always like to be busy our 
Granny is busy knitting gloves. Her hands go to and fro. 
She will keep on working xmtil her knitting is done. Now 
that it is done she carefully folds her work and packs it 

16 into her workbasket. Then she trots upstairs to bed and 

oh, how lonesome it is when our dear Granny is gone 

from the room. 

Merits 

The merits of this composition are : (1) the dear and pleasing im- 
pression obtained; (2) the happy choice of details and the logical 
sequence of their arrangement ; (3) the sympathetic treatment of the 
subject — for example, bits of sentiment seen in the grandmother's 
attachment to the slippers, and the loneliness felt when she goes to 
her room; (4) the interesting introductory sentence; and (6) the 
mechanical accuracy. 

Defects 

The defects are: (1) the rather monotonous sentence structure, 
and (2) the childish vocabulary. 

Comparison 

To justify its place in the scale, note : (1) that In No. 1 there is 
successfully treated a much more difficult subject; (2) there is a 
greater power of imagination; and (3) there is a greater variety of 
sentence structure and a richer vocabulary. 
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No. 3. "C" GRADE COMPOSITION. VALUE, 76.1 9J 



As you look across the road you will first see a long 
private avenue or walk. 

It is in the summer, and on each side of this long walk 
are some beautiful, stately elms. They are hundreds of 
years old and they have done their duty for as many, 6 
years, shading the walk from the noon sun. 

Cross the road and you will see if you look up the 
avenue, a beautiful mansion. It is a colonial house and 
four large pillars are upholding the roof. A piazza runs 
along three sides of the house. lo 

Near the house is a tennis court where for years the 
occupants of the mansion have passed many an hour. 

Let us enter the mansion. It is a beautiful cool place, 
although dark. As we enter we see large psalms on each 
side of the entrance. On the floors are old oriental rugs i5 
which have been handed down for generations. In the 
parlor is a harp, and on the walls are the portraits of the 
In all, it is a beautiful place. 



The writer of this theme has presented a clear though conven- 
tional picture. Although he changes his point of view several times, 
he haa attempted to put his readers into the best positions to see the 
mansion. The choice of words is fair. Such details as the slalely 
ehns, the oriental rugs, the harp, and the portraits are well selected. 
Only one miatalte in spelling occurs (line 14). 



k 



Defects 

There are, however, too many paragraphs tor such a short theme. 
Constant repetition of the pronoun j/ou, and ot the words beauliful 
and mansion give an impression of monotony and of limited vocabu- 
lary. The pupil has evidently a definite place in mind, but has not 
suggested the spirit of the scene, as has the writer of No. 2. 
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Comparison 

The composition deserves its place in the scale above No. 4 be- 
cause of better sentence structure and more orderly arrangement. 
It is inferior to No. 2 on account of its somewhat prosaic tone and its 
constantly changing point of view. 

No. 4. "D" GRADE COMPOSITION. VALUE, 66.6% 

The Lake at Sunrise 

In the Moxintains of Pennsylvania there is a lake. 
On one side of the lake is a boat landing, at which a 
dozen or more boats are tied up. On this boat landing 
one may stand and look up the lake, at sunrise, and see 
6 the sun peering up over the top of the mountains and 
shinning on the water. Then a King Fisher files down the 
lake making his cheerful noise, instantly, all the other 
birds begin to chirp as if their life depended on it. 
Looking across the lake one would see numerous wells 
10 and coves backed up by woods from which comes the chirp 
of the birds. Hearing the explosions of cylinders we look 
to see where in comes from and find a pumphouse that 
keeps the lake supplied with water. 
Looking down the lake over the dam to the ice house 
16 with the roof sparkling with. On the roof of the house a 
hawk is sitting adding his clear whistle to noise of other 
birds. 

Looking around to the woods, at our back, with an old 
oil well in front of them. The birds flying from the woods 
20 in flocks, and far away from the hills comes the sound of 
the of Italians singing. 

Merits 

The writer has seen and heard concrete details and has re-created 
his images clearly. He has tried, too, to make his point of view 
obvious to the reader. His vocabulary is adequate. 



Defects 

As a deacription the composition fails because there ia no unified 
picture ot the lake. The selected details, clear in themselves, tend 
to distract rather than center the interest. There are numerous 
mechanical errors: there should be no commas after lake or iunrise 
(line 4) ; skinirig (line 6) is misspelled ; there should be a period after 
noise (line 7), and no comma after instantly (line 7), which should 
commence with a capital ; in Qiae 12) is not correct ; the groups of 
■words in lines 14, 15, and lines 17, 18 do not make sentences; 
the word ihe is omitted before noise (line 16) and the word are before 
flying Qine 18). 



The theme merits its rank in the scale by superiority in spelling, 
paragraphing, and maturity ot thought. It does not, on the other 
hand, show equal masteryin the fine details, the discriminating vocabu- 
lary, and in the ability to stick to the point. The ai 
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No. 6. "E" GRADE COMPOSITION. VALUE, 55.4% 

A Light House 

A description of a light house is quite interesting. 

First a light house is generally situated on a mass of 
rocks in the ocean or on some great lake. And then to 
get into a light house is a question. Some times you have 
to climb to the top on a steal ladder, and again you only s 
have to go half way up and you find sort of a steal porch, 
which is very strong with a door in the side of the light 
house. On the very top of the light there is generally 
two or three life boats in case of accidents. In side there 
is an enormous light which flashes every two minutes and lo 
sometimes more often it depends holy on the weather. 
The man himself has very favorable sleeping quarter and 
food it is a very lonely life except when you have a man 
with you. Sometimes they play cards all day long until 
it is time to fix the lights and then they are very busy. 15 
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The merits of this theme are: (1) the evident spirit of faithful 
accuracy ; and (2) a succeaaful use of certain simple vorda, — aueh aa 
mass o/ roela, enormoug light, and lonely life. 

Defects 

Many obvious defects warrant its low poaition in the scale. The 
pupil was aaked to write a description. After announcing his pur- 
pose to do this, he writes an exposition, or explanation of lighthouses 
in general. The first sentence of the theme ia worthleaa, contributing 
nothing toward the development of the subject. It should be omitted. 
The paragraph ia full of miaspelled words and grammatical slips; 
steal, in side, holj/, some limes, sleepirtg quarter. The most striking 
weaknesa of the work is the loose and rambling form of the sentences, 
indicating indefinite thought, "Run-on" sentences are found in 
lines 9-13. No attempt has been made to establish a point of view. 
On this account, and because of a lack of vivid words, the passage ia 
dead and colorless. 

Comparison 

a placed above No. 6 because it contains fewer 



NO. G. "F" GRADE COMPOSITION. VALUE, 44.9% 

A Scene on the Prairies 

Along a large plain in the west with mountains on all 
sides. The sun was just sinking behind the mountains. 
Some trappers were on the plain just about to get their 
supper. They had one tend because there was just three 
6 of them. Beside their tent tripled a little spring. After 
the three trappers had eating there supper they sat down 
by the fire because it had growing dark. All of a sudden 
a bunch of Indain's came riding up. When they came 
near they fired of their guns and disappered in the dark- 
loness and the trappers turned into camp leaving one a the 
trappers on gaurd. 



J 
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Merits 

The oommendable features of this composition are directness, 
simplicity, and a logical arrangement of details. The writer passes 
from the general to the specific in a natural manner. In spite of a 
change in the point of view in the last two sentences, the paragraph, 
as a whole, mtikes a clear picture. 

Defects 

Blunders in grammar and in spelling, lack of sentence-sense, and 
short, childish sentences make the rating of the composition necessarily 
very low. Such errors as tend for tent, tripled for trickled, eating for 
eaten, gratving for grown, and the misspelling of Indians indicate 
either hasty, careless work, or slovenly habits of enunciation. 

Comparison 

Compared with the descriptions of the storm and of grandmother, 
the short sentences here show immaturity and weakness rather than 
skill or force. With a large amount of correcting of mechanical de- 
tails, but with very little revising as a whole, this composition would 
be superior to No. 5. 

The scales and tables in this section are reproduced by the courtesy 
of Dr. F. W. Ballou. 
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EFFECT OF USING THE SCALE 

An initial experiment in the use of the description scale 
was made in Arlington and Boston. Eighth grade teachers 
and elementary school principals in these two cities graded 
a set of twenty-five eighth grade compositions secured for 
this purpose, both without the use of the scale and with 
it. With the use of the scale the results showed a reduc- 
tion in the extreme variation of judgments; that is, no 
two teachers were quite so widely divergent as before. 
The average variation was also less. But in this matter 
neither the average nor the extreme variation is the most 
important consideration. Far more important is the 
effect which the use of the scale has on the grading of each 
individual teacher. To ascertain this is obviously a com- 
plicated matter, and it requires more time than has been 
thus far at our disposal. This phase of the problem will 
be the subject of further investigation. 

The compositions used in the scale were selected from 
a large number written by the eighth grade pupils of 
Newton as a part of their regular school work. Each 
pupil was given his choice among several topics of descrip- 
tion, narration, exposition, and argumentation, suggested 
by himself or the teacher, and was required to write a 
composition of about a page in length. Time for prepara- 
tion and correction was allowed. Thus, these composi- 
tions represented the best unaided writing of the indi- 
vidual children in the eighth grade of that particular city. 
Then a selection from all these compositions was made 
by the individual eighth grade teachers. This selection 
included at least 25% of all the compositions written in a 
particular class and was made with the view of securing 
compositions representing all degrees of ability in that 
class. The compositions were then numerically graded 
by the eighth grade teacher and the principal, inde- 
pendently. To be sure of securing compositions deserv- 
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ing the highest grade of merit, namely, "A" or 95%, 
each school, in addition, sent in from one to three of its 
"best" compositions in all four types of writing, as 
judged by the teacher and principal. Twenty-five samples 
of each one of the four types of composition ^description, 
narration, exposition, and argumentation — seemed a 
sufficient number from which to select the six composi- 
tions to be used in the final construction of each one 
of the four scales. Twenty-five samples, then, of 
each tjTse were selected on the basis of the preliminary 
grading given the compositions by the teachers and prin- 
cipals and on the Judgment of Ballou, director of the 
experiment. 

To eliminate any possible influence of handwriting 
these samples were typewritten and mimeographed. 
Then one set, consisting of 25 samples of each of the four 
types of composition, was sent to each of the eighth 
grade teachers and principals, 25 in all, with instructions 

(1) to grade each of the compositions independently and 

(2) to rank each in the order of its merit. 

Because of the probability that 95% rather than 100% 
would represent the highest degree of efficiency in com- 
position writing in the eighth grade, and because it was 
desirable that each reader should start from the same 
point in marking the compositions, the teachers were 
asked to give 95% to the best compositions. Although 
no lower limit was fixed, 40% was intended to be that 
limit ; for compositions worth less than that were not to 
be furnished by the schools for the experiment. 

As already stated each composition was graded by 25 
teachers, and, when the marks came in, five things were 
noted with regard to each of them : 

(1) Its average mark (found by dividing the sura of all 
the marks by 25). 

(2) Its median mark (found by ranging all the marks 
^ven it in order from the highest to the lowest and taking 
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the middle one). (This is easier to find than the average 
and for many purposes it is better.) 

(3) The highest mark given it. 

(4) The lowest mark given it. 

(5) The difference between these two, which is the 
maximum variation in the marking of these particular 
compositions. 

Marks Given to the Twenty-five CoMPOsmoNS 



Composi- 


HlOUUST 


Lowest 


Maximum 


Mban or Avbr- 


Mbdian^ 


tion 

NnUBBB 


Graob 


Graob 


Variation 


AOB GrADB 


Gradb 


1 


95 


68 


27 


91.9 


83.0 


2 


90 


64 


26 


80.0 


80.0 


3 


50 


30 


20 


42.7 


41.0 


4 


94 


63 


31 


84.3 


85.5 


5 


78 


50 


28 


61.1 


60.0 


6 


88 


50 


38 


69.4 


69.5 


7 


80 


40 


40 


63.5 


65.0 


8 


95 


52 


43 


82.3 


85.0 


9 


75 


40 


35 


56.1 


58.5 


10 


95 


90 


5 


94.5 


95.0 


11 


65 


40 


25 


49.5 


49.5 


12 


75 


42 


33 


59.9 


60.0 


13 


95 


71 


24 


83.7 


85.0 


14 


76 


40 


36 


55.4 


53.5 


15 


95 


80 


15 


89.6 


90.0 


16 


92 


68 


24 


78.2 


78.5 


17 


93 


63 


30 


81.0 


81.5 


18 


90 


60 


30 


79.9 


75.0 


19 


92 


60 


32 


79.6 


80.0 


20 


92 


70 


22 


82.7 


85.0 


21 


89 


54 


35 


76.1 


77.0 


22 


86 


47 


39 


66.6 


66.5 


23 


74 


40 


34 


55.4 


57.5 


24 


73 


30 


43 


48.9 


48.0 


25 


62 


20 


42 


44.9 


45.0 



As a check on the results of the gradings, the retmns 
from the rankings were also tabulated and the same 
items noted as in the case of the grades. 

* "Median grade" is the grade in the series of grades above which 
and below which there is an equal number of grades. 
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After the various items in both grading and ranking 
had been recorded for each composition, using these data 
as a basis, it was necessary to choose the compositions 
best fitted to have a place in the scale. It is obvious 
that compositions about which there was most agreement 
in judgment on the part of the teachers, both as to rank 
and grade — that is, compositions with low maximum 
variations — were most desirable ; furthermore, since it 
was the intention of the authors of the scale that the six 
compositions selected should represent 95%, 85%, 75%, 
65%, 55% and 45%, respectively, in choosing the composi- 
tions for the scale they accordingly selected those whose 
average and median marks came nearest those require- 
ments. 

In short, in constructing the scale there were no fixed 
requu^menta set. The compositions selected were those 
about which there was the least disagreement as to merit 
and whose marks approximated those desired in the scale. 
After the six compositions had been selected on this 
basis, the teachers were asked to point out in a brief para- 
graph the merits and defects of each of the compositions. 
These paragraphs were carefully studied and compared 
by a committee who, acting under expert advice, put the 
various criticisms into the form shown in the scale already 
presented. 

The method of using this scale is very simple. The 
composition to be measured is compared directly with 
those in the appropriate scale — description, narration, 
etc. — and its value determined in terras of the marks 
assigned to the sample composition which it most nearly 
approaches in quality. Thus a descriptive composition 
is placed alongside the compositions in the description 
scale, a narrative composition alongside the compositions 
in the narration scale, etc. If the composition to be 
measured seems to possess the same qualities as a given 
composition in the scale — say the composition represent- 



ing grade "B" in the description scale — then it is 
assigned the same value as that composition, namely 
grade "B" or 83.5%. If its value seems to lie some- 
where between two grades on the scale as represented by 
two compositions, say "A" (94.6%) and "B" (83.5%), 
the examiner can determine its value as precisely as he 
pleases according to its apparent distance below the one 
and above the other. 

In spite of the difficulty of comparing a sample of com- 
position writing of one type with a sample of another 
type, as is necessary in using the Hillegas Scale, in actual 
practice the Hillegas Scale has on the whole been used to 
greater advantage than the Harvard-Newton Scale. 
This has been due chiefly to the fact that the field in 
which the former may be used — the elementary grades 
and high school — is not as limited as that of the latter, 
which is confined to the eighth grade. However, for 
eighth grade measurements the Harvard-Newton Scale 
may obviously be used to better advantage. 

The teacher may obtain the Hillegas Scale by sending 
to Teachers College, Columbia University, New York. 
To recapitulate, all that need be done in using it is to 
slide the composition to be measured along the scale — 
as in the case of the handwriting scales — beginning with 
the sample marked 0, until a sample is reached on the 
scale to which the specimen to be measured most closely 
corresponds in quality. As has been said, the former 
may be of an entirely different type from the latter. 
The composition to be measured is then given the same 
value as the one on the scale to which it is most similar 
in quality. That is, if it appears to be very like the com- 
position marked 77 it is given the value 77. If it seems to 
be better than composition 77 but not so good as the 
next composition in the scale, number 83, it is given a 
value somewhere between 77 and 83 such as 79 or 81. 

Teachers of the eighth grade may obtain the Harvard- 
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Newton Scale by sending to The Harvard University 
Press, Boston, Mass. In using it, a deaeriptive composi- 
tion is measured by comparing it with the sample com- 
positions on the description scale, a narrative composi- 
tion, by comparing it with samples in the narration scale, 
etc. 

Whichever scale is used, in obtaining the compositions 
to be measured, the teacher must see first of all that the 
same amount of time for writing is allowed to all the 
pupils and, secondly, that the same subject is given to 
all to write upon. Even in thus making the conditions 
under which the compositions are obtained as objectively 
uniform as possible, it is apparent that certain subjective 
influences, such as interest for example, which cannot be 
eliminated, are bound to affect the result. Furthermore, 
within the same class there will be the widest difference 
in the amount of material written. 

While it is evident that in disregarding these two fac- 
tors the scales are not complete as adequate measures of 
composition writing, still they are of great value ; for by 
their use the composition work of any grade, school, or 
system of schools in any part of the country may be 
compared with that of any other, and the results of dif- 
ferent methods of instruction or of other conditions ascer- 
tained and utilized. Moreover, there is so intimate a 
relation between the successful use of oral and written 
language and intelligence that an objective standard which 
accurately measures ability in the use of language also 
measures, to a certain extent, the possession of mental 
ability in general. In the writing of English composi- 
tion, whatever its type, children are compelled, or should 
be compelled, above everything else to make themselves 
clear, and, by the use of a uniform standard of judgment, 
the growth of reason itself, from grade to grade, may be 
followed and subnormal or supernormal children detected. 
Then, too, the difference shown by the same child in the 
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various types of composition may give a fair idea of his 
individuality. Increased knowledge of the various tj^pes 
of pupils with which the school has to deal will naturally 
lead to greater variety in teaching and correspondingly 
better results with the children. Any such educational 
progress, however, will come not as an expression of mere 
opinion, but as the result of scientifically determined 
educational facts obtained by the use of objective stand- 
ards. The more scientific, yet comprehensible, are our 
methods of investigation, the more valuable will be their 
results. 

EXERCISES 

1. In what way may these scales be utilized to secure a very accu- 
rate judgment of the merit of a given composition? 

2. What relation seems to exist between ability in composition 
writing and ability in other subjects in the curriculum? Between 
ability in composition writing and general intelligence? 

3. Procure twenty compositions from various grades and get five 
teachers to mark them on a percentage basis. What do the results 
show regarding the reliability of such measures? 

4. How would the ratings given by five teachers to twenty com- 
positions of varying merit test the reliability of the Hillegas Scale? 

5. Suppose the Composition Scale revealed a great difference in 
the same child in the various types of composition writing, of what 
value would this be to the teacher? 

6. Obtain forty specimens of English composition from the various 
grades. Grade these on the Hillegas Scale. Allow one month to 
elapse and grade again. What do the results show? 

7. In what type of composition writing do you think a child should 
be most proficient? 

8. Suppose a teacher discovered by the use of the scales that the 
pupils on the whole showed far greater efficiency in one type of com- 
position writing than in another, what should be the conclusion? 

9. How would you modify the standard for composition writing 
for your particular grade? Why? 

10. What modifications would you make in it if your pupils came 
from a foreign neighborhood? 




CHAPTER VII 

COMPLETION TEST LANGUAGE SCALES — TRABUE 

Suppose we consider an incomplete sentence such as 
the following: "The . . . rises . . . the morning and 
... at night," where three words are omitted, the 
place of each word being filled by a dotted line ; it is a 
simple matter for any one who is acquainted with the 
English language to insert a word in each of these three 
blank spaces, which will cause the sentence to make sense. 
In the above example, these words are "sun," "in," and 
"sets," making the sentence read: "The sun rises in the 
morning and sets at night." The completion of sentences 
of this kind, while not actually testing ability in English 
composition, demands an ability very closely related to 
what is usually called "language ability"; at any rate, 
it involves a power to read and think about printed words 
which has great educational significance. 

From the nature of this test it is obvious that we may 
have sentences for completion of all degrees of difficulty. 
I "While a sentence such as, "The sky . . . blue," requires 
■ next to no ability in English language, a sentence such 
as the following; "To . . . friends is always . . . the 
.... it takes," is of sufficient difficulty to test the 
ability of a college student. If, therefore, we could select 
a series of incomplete sentences increasing in difficulty 
from the first to the last, with this as a scale, we should 
be in a position to measure the language ability of any 
individual or group. This could be accomplished by 
allowing a certain specified time in which to complete as 
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many of the sentences as possible. To construct such a 
scale for the measurement of language ability of this 
type was the object of the study made by Trabue. 

A large number of incomplete sentences were con- 
structed. After a preliminary trial fifty-six of these sen- 
tences were selected and their relative difEculty deter- 
mined by administering them, under standard conditions, 
to several thousand children and young people in various 
school systems. The detailed scheme by which each 
sentence was marked will be described later, but the 
general method was to give a score of 2 for a perfect com- 
pletion, a score of 1 for an almost but not quite perfect 
completion, and a score of for a failure to attempt or 
for an imperfect completion. 

By determining the different scores made on the sen- 
tences in the various grades, it was possible to calculate 
the relative difficulty of each of these sentences. Thus, 
two sentences were considered of equal difficulty when 
they were completed by the same percentage of individuals 
tested. The greater the difference of percentage attained 
in completing two sentences, the greater was the difference 
in the difficulties of the sentences. It is impossible to 
enter into the details of these calculations, but the method 
employed was essentially the same as that described in 
the construction of the Buckingham Spelling Scale. 

Knowing the difficulty of these original sentences, 
Trabue constructed eight short scales. The following 
are some of the reasons for the use of several short scales : 

(1) A short scale takes less time to administer and score ; 

(2) a measure of ability is more reliable when taken on 
two separate occasions than when taken at one time; 

(3) a number of scales of equal difficulty admit of a class 
being tested from time to time, the use of different scales 
being necessary to eliminate the factor of memory. 

Two scales, called by the author B and C, are here 
shown ; in the study six similar scales are also given. 
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Language Scale B 

Write only one word on each blank. Time limits seven mintUes. 

Name 



1. We like good bojrs girls. 

6. The is barking at the cat. 

8. The stars and the will shine tonight. 

22. Time often more valuable money. 

23. The poor baby as if it were sick. 

31. She if shewiU. 

35. Brothers and sisters always to help other 

and should quarrel. 

38 weather usually a good effect one's 

spirits. 
48. It is very annoying to tooth-ache, 

often comes at the most time imaginable. 

54. To friends is alwajrs the it takes. 



Language Scale C 

Write only one word on each blank. Time limit, seven minutes. 

Name 



2. The sky blue. 

5. Men older than bojrs. 

12. Good boys kind their sisters.^ 

19. The girl fell and her head. 

24. The rises the morning and at night. 

30. The boy who hard do well. 

37. Men more to do heavy work women. 

44. The sun is so that one can not 

directly causing great discomfort to the eyes. 

53. The knowledge of use fire is of 

important things known by but unknown 

animals. 
56. One ought to great care to the right of 

, f or one who bad habits it 

to get away from them. 

The scales in this section are reproduced by the courtesy of Dr. 
M. R. Trabue. 



\ 



160 Scientific Measurement 

Each of these scales consists of ten steps or sentences, 
the intervals between the various sentences being approxi- 
mately equal ; that is, sentence 6 is as much more difficult 
than sentence 1, as sentence 8 is more difficult than sen- 
tence 6, and so on. It should, however, be noted that 
Scale C is, on the whole, a little harder than Scale B, Sen- 
tence 2 in Scale C is a little more difficult than sentence 
1 in Scale B, and sentence 5 in Scale C is a little more 
difficult than sentence 6 in Scale B. The same is true 
throughout the series. 

Directions for Administering the Test 
The scales which have been described may be pur- 
chased in any quantity from the Bureau of Publications, 
Teachers College, New York, It should be noted that 
these standard blanks must be used if the results 
obtained are to be used for comparative purposes. 
When the test is given to a third or lower grade, it 
is necessary to give a little preliminary training, using a 
practice sheet, which can be secured with the regular 
tests. In the fourth grade and above, the following oral 
explanation should be made before distributing any 
papers: 

This sheet contains some incomplete Bent«ncea, which fonn a 
scale. This scale is to measure how carefully and rapidly you can 
think, and especially how good you are in your language work. 

You are to write one word on each blank, in each case selecting the 
word which makes the moat sensible statement. 

You may have just seven minutes in which to sign your name at 
the top of the page and write the words that are missing. The papers 
will be passed to you with the face downward. Do not turn them 
over until we are all ready. After the signal is given to start, re- 
member that you are to write just one word on each blank and that 
your score depends on the number of perfect aentencea you have at 
the end of seven minutes. 

If there are no questions, the papers may then be dis- 
tributed, taking care that no child looks at the 
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fflde until there is a paper upon the desk of each child 
and the following additional instructions have been given : 
After you have been working seven minutes, I sliall aay, "The 
time ia up. All stop writing ! " You will all please stop at once and 
lay aside your pens (or pencils). Now if you are all ready, you may 
turn your papers, sign your names and fill the blanks. 

Take note of the exact time at which the signal to start 
was given, allow exactly seven minutes, and give the 
command to stop writing. Collect all papers at once. 
It is very important that exactly seven minutes be al- 
lowed. A stop watch is the most satisfactory means of 
keeping the time on a test of this sort. Grade each paper 
according to the general scheme about to be described, and 
make a record of the total number of points made by each 
pupil, in order that the amount of progress of each indi- 
vidual may be determined when this scale is used for a 
second time, or when another scale is employed. Then 
arrange the scores in ascending order and find out the 
median score ; namely, that point above and below which 
there are an equal number of scores. This median value 
may then be compared with the medians obtained by 
other classes. 

General Scheme of Scoring 
The following general scheme has been the basis upon 
which the more detailed judgments have been based : 

Score g 
A score of 2 points is to be given each sentence completed perfectly. 
Errors in spelling, capitalization, and punctuation should not be 
allowed to affect the score. 

A score of 1 ia to b« given each sentence completed with only a 
Blight imperfection. A poorly chosen word or a common gram- 
matical error, which makes the sentence less than perfect and yet 
leaves it with reasonably good sense, should serve to reduce the Bcora 
from 2 to 1. 
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Score 

A score of is to be given if the sentence as completed has its 
sense or construction badly distorted. A sentence must have reason- 
ably good meaning and express a sentiment which might honestly be 
held by an intelligent person in order to receive a higher credit than 
zero. 

It is apparent that the above method of scoring leaves 
more than is desirable to the judgment of the person 
who is rating the sentence. This subjective element in 
the marking is much reduced, however, by a careful con- 
sideration of the examples given by the author of what 
in his opinion constitutes a sentence wwth the score 2, 1, 
and 0, respectively. For illustration take the sentence : 

30. The boy who hard do well. 

Score 2 

works, tries, studies, thinks, will. 

Score 1 

tries .... can, may, does, shall, should, could, must, 

worked, tried, .... did, will, can, 

plays, hits, work, .... will. 
Score 

tries .... sometimes, surely, often, 

did .... work did, does .... work, work .... did, 

All the other sentences are treated similarly. The reader 
is referred to the original study for these completions, as 
they are too bulky to warrant introduction here. 

It will be noticed that the score is given for the whole 
sentence; that is, in those cases where more than one 
blank appears, the mark is not given for each single com- 
pletion but for the whole sentence. 

To summarize : All that is necessary to test a class in 
the type of language ability measured by these scales, 
is to procure the standard blanks from the publishers. 
Follow carefully the directions for the administration of 
the test. Score the tests according to the scheme out- 
lined. Determine the score below which and above which 
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there are an equal number of pupU's records, and then 
compare this median value with previous records, if such 
have been obtained ; if not these first results will estab- 
lish tentative standards. 

EXERCISES 

1. How could you rank five completion tests, of your own con- 
struction, according to their difficulty? What is the test of a suit- 
able sentence for a particular group? 

2. What is the advantage of having the difficulty of the sentences 
in the scale rise by equal increments? What would happen if three 
of the sentences were of the same difficulty? 

3. How would you use completion tests for determining whether 
the pupils had read a certain assignment of history or geography? 

4. To what extent do these completion tests measure a valuable 
language ability? How does this type of ability compare with 
abiUty in English Composition in your dass? 

5. How could the idea of the completion sentence be employed to 
measure ability in a foreign language? 

6. Can you reasonably expect the same standard of work, in this 
test, from schools in a foreign district, and in an Englishnspeaking 
district? How could a school of the first type establish its own 
standards? 

7. How would you determine the standard of your own class in 
this test, as compared with other classes of the same grade? 

8. State how you would compare the standing of your own school 
with that of another school? What conditions would have to be 
fulfilled to make this comparison justifiable? 

9. Are completion sentences merely a test, or could they be used 
with advantage as an exercise to increase thought in language lessons? 

10. Suppose a grade fell notably below its average of the last few 
years, what steps would you take to meet this decline? 
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DRAWING SCALE 

THORNDKE DRAWING SCALE 

The measurement of improvement and efficiency in a 
subject such as drawing is beset with great difficulties. 
It is reasonable to suppose that in art the judgment of 
excellence depends on the individual teacher, to a greater 
extent than in most of the other subjects in the school 
course. In spite of this supposition, Thomdike in 1913 
presented a scale which, though merely tentative, yet 
limits to a great degree the possible differences of individual 
opinion in estimating drawing ability. Its method of 
derivation is very similar to that employed in the scale 
for the measurement of English composition. From 45 
carefully selected drawings from Kerschensteiner's "Die 
Entwickelung der zeichnerischen Begabung," a more 
limited selection of 14 drawings was made. These, 
together with a drawing from another source, constituted 
the 15 samples. These samples were then submitted to 
artists, teachers, and students of education and psychol- 
ogy, with the request that they be ranked in the order 
of merit : that is, that No. 1 be assigned to the drawing 
which, in the opinion of the judges, is the best ; No, 2, 
to the drawing that is the next best, etc. ; No, 15 being as- 
signed to the very worst drawing. It was stated quite 
clearly that no allowance should be made for the apparent 
age or training of those who had made the drawings, but 
that the drawings should all be judged by the standard 
of their intrinsic merit. In all, 376 ratings or rankings of 
the 16 drawings were obtained, 60 of which were from 
164 
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1651 



A Scale for the Merit of Drawings by 
Pupils 8 to IS Years Old 

I The numbera give the merit of the drawing as judged by 400 artists, 
teachers of drawing and men expert in education in general 
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artists who had sufficient merit to be included in "Who's 
Who in America." 

Suppose the drawings be called a, b, c, d, e, f, g, h, i, j, 
k, I, m, n, and o. These fifteen drawings were so chosen 
that they proceeded step by step from a drawing of almost 
zero merit, to a drawing of such a high order, that only 
one child out of five thousand under fifteen years of age 
was able to produce work of that degree of excellence. 
When the data which came from all the judges were col- 
lected, an idea was obtained of the relative merit of each 
of the samples of drawing. Thus, suppose it was desired 
to compare sample b with sample a, and it was known 
that 95% of the judges rated 6 as having more merit than 
a, while 85% rated c as having more merit than b. Prom 
general considerations, it was safe to assume that the dif- 
ference in quality between sample b and sample a was 
greater than the difference in quality between sample b 
and sample c. This can be seen at once if we consider 
what it means when 100% of the judges rank one sample 
greater than another sample ; for, in this case, the superior 
sample is so much better than the inferior sample, that 
not one judge in a hundred thinks it inferior. Thus, if 
we compare the plays of Marlowe and Shakespeare by 
this method, there is such a great difference in quality, 
that 100% of competent judges would think Shakespeare 
superior to Marlowe. 

Let us consider for one moment what is implied by the 
statement that 50% of the judges ranked specimen X as 
better than specimen Y; in this case, as many judges 
thought Y was better than X as thought X was better 
than Y. Under these conditions, if the judges are com- 
petent and sufficiently numerous, we are justified in assum- 
ing that X is equal to y in merit. Thus, if 100 people 
were to compare the merits of two novels, such as "Silas 
Mamer" and "Scenes from Clerical Life," and it was 
found that 50% of the judges thought "Silas Mamer" 
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was superior and 50% thought ''Scenes from Clerical 
Life'' was superior, we should be justified in assuming 
that the two novels were of approximately equal ^merit. 
To summarize, when 100% of the judgments rank X as 
superior to Y, then X is in all probability very far re- 
moved in merit from Y; whereas, when 50% of the 
judgments rank X as superior to Y, then X and Y are 
approximately equal in merit. The results of the rating 
of the drawings by 187 judges are shown below in the 
table. 



RATINGS OF DRAWINGS 
94.85% of the judges rated h as better than a. 
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By simple, but laborious statistical treatment, which it 
is unnecessary to discuss here, based on the two facts 
given above, it is possible to arrange the various samples 
in an order of merit, and to assign to each a numerical 
value which is the result not of a single judgment but of 
the combined estimates of many experts. That is, if we 
assign zero merit to the first picture, which is supi>osed 
to be a picture of a man, then by an analysis of the 
table just given it can be shown that the second figure, 
which is intended to be a house, has 2.4 degrees of 
merit. On the same scale. Figure 3, which is also 
supposed to be a house, has 3.9 degrees of merit, and 



BO on, until we reach the last three samples, which 
have 14.4, 16, and 17 degrees of merit, respectively. A 
scale so constructed enables us to measure skill and im- 
provement in drawing by methods which are largely 
ob]*ective. 

In the matter of assigning actual values to the drawings, 
care must be taken not to assume that the degree of im- 
provement, say from a sample which ranks 6 to a sample 
ranking 10, is equal to that from a sample ranking 12 to 
one ranking 16, in the sense that a rise in a temperature 
scale from 6° to 10° is equal to a rise from 12° to 16°, 
In the case of the scale for measuring drawing, this is 
true in a very limited sense only, but the scale can be 
used with a maximum return without an understanding 
of these statistical considerations. In other words, when 
a teacher says that the average ability of a class accord- 
ing to the Thorndike Drawing Scale is 13.5, it conveys a 
reasonably definite idea to any other person who is ac- 
quainted with that scale. For all practical purposes the 
samples constituting the scale, as used by the average 
teacher, might have been lettered instead of having nu- 
merical values attached. 

When it is desu-ed to measure the ability of a class by 
using this scale, all that is necessary is to choose a certain 
model or subject and allow a measured time for the 
drawing ; this time should be varied according to the 
nature of the subject. The subject and the time allowed 
should be noted very carefully, so that when the test is 
given again, all these external conditions may be the 
same. When the drawings are collected each one is 
measured by being placed" alongside the scale, and its 
position estimated by the teacher, or by several teachers. 
If it appears to lie between two points of the scale, an 
intermediate value may be given. 

This still leaves a considerable amount to the individual 
judgment. In other words, the scale is not by any means 
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purely objective, for equally competent persons would 
fail to assign the same degree of merit to the same draw- 
ing. This factor of personal opmion can however be 
curtailed by having several individuals measure the 
drawing by the scale and taking the average of their 
judgments. The drawing scale, like any other scale In 
its beginnings, is very incomplete, since it still remains 
to work out scales for all the various tjrpes of drawings 
taught in the schools. But any scale is better than no 
scale at all, and continued use of a drawing scale by 
teachers will standardize judgments and encourage quan- 
titative thinking, even in this study which at present is 
so dependent on personal opinion. 

EXERCISES 

1. Take 30 specimens of drawing, distributed through the grades, 
and mark them according to your usual method; let one month 
elapse and grade them again. What do the results show? 

2. Repeat the above experiment, with the exception that the 
grading is done by means of the Thomdike Scale. How do the two 
ratings differ? Compare with the results of the previous experiment. 

3. Why is it necessary to take careful note of the time allowed 
for the test? Why must this be the same when the test is repeated, 
if the grading is to be used to measure improvement? 

4. Why cannot we divide children into two classes — "good 
drawers" and "bad drawers"? 

5. How would you proceed to establish norms or standards for 
drawing ability in the various grades in your school? 

6. On the analogy of the Harvard-Newton Scale, how would you 
propose to construct a better method of measuring drawing ability? 

7. Take 5 specimens of drawing from each of the grades; have 
these rated on the scale by .5 different individuals. How would these 
results give you an indication of the reliability of the scale? 
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CHAPTER IX 
THE APPLICATION OF THE SCALES IN THE SCHOOLS 

Objective Scales in Other Subjects. Scales for the 
measurement of other school products have yet to be 
evolved ; the subject is still in its begimiings. In addi- 
tion to those scales already described, attempts have been 
made to measure objectively mechanical constructive 
ability and ability in the translation of Latin, while scales 
are in process of formation for the measurement of ability 
in several of the modem languages, in algebra and geom- 
etry, and in some of the natural sciences. One of the 
authors is at present conducting an experiment, extending 
over two years, the results of which will standardize the 
rate of improvement in typewriting using the touch 
method. 

A point of interest arises as to whether scales can be 
worked out for informational subjects such as history, 
geography, etc. ; for at once we have to face the great 
difficulty that in subjects such as these we have to meas- 
ure knowledge of facts or content rather than skill or 
method. The previous study of the writing scale has 
little effect on a child's proficiency in writing, but the 
study of a scale for the measurement of content or facts 
in history, prior to the examination, renders that scale 
valueless as a test. For the particular facts can be 
learned, and the knowledge of these will not indicate any 
general knowledge of the whole field. This means that 
in measuring efiiciency in certain subjects, we may have 
to resort to analysis, and use one objective standardized 
teat to measure method, and another more or leas sub- 
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jective test to measure content. Whether it will ever be 
possible to use a universal and unchanging scale for 
content values remains doubtful. If a very large num- 
ber of content questions, sufficiently wide to cover the 
field, could be standardized as regards difficulty, there is 
no reason why a purely objective scale, consisting of a 
few of these questions selected at random, should not be 
employed. 

The adoption of these objective scales for the measure- 
ment of school products is bound to establish a scientific 
attitude in the schools, which will energize and direct the 
work of the teachers and raise the administrator's task 
from the realm of mere opinion to the level of scientific 
judgment. 

Standardization of the Objective Scales. The standard- 
ization of these universal tests will involve a considerable 
amount of work if accurate and complete norms are 
to be established. In some eases it may be advisable to 
have the test standardized not only as regards the prod- 
uct of each grade, but also with reference to age. For 
example, in handwriting — a distinctly motor function — 
it may be well to know the quality of work expected at a 
certain age, as well as in a certain grade. A pupil may 
be held back in a grade because of failure in arithmetic 
and reading and so become over age. Under these condi- 
tions a motor function such as handwriting may continue 
to improve normally, so that even though the child is in 
a low grade, we may expect of him the normal standard 
product of his age in that subject. 

As these tests come nto common use in the classroom, 
the interest of the individual teacher will cease to be con- 
fined merely to the average of the particular grade, and 
attention will more and more be directed to deviations 
from that average which may normally be expected. In 
fact one of the great services of these tests is to reveal 
the great individual differences in ability that exist even 




in the same class. A teacher of Grade V will not only 
be interested in knowing that the average achievement of 
the class in a particular test, say in the Courtis Test, 
Fundamentals 7, should be 9,0, but will also appreciate 
the advantage of knowing how the class groups itself 
around this average, what are the extreme deviations in- 
dicating the lowest and highest type of work in the class. 
In fact, as will be seen, these scales may be used for a 
variety of purposes by a teacher who is really interested 
in the work of the individuals of the class. 

The Relation of the Objective Scales to Continuous School 
Records. The application of statistics to education is 
not really a new idea ; in certain realms of adminis- 
tration, such as attendance, per capita cost, etc., such 
measurements have always been made. What is claimed 
is that this method should extend to all possible phases 
of classroom work. The ordinary examination fails to do 
this ; the questions are arbitrary, they are not weighted 
according to their relative values, there are no objective 
standards of accomplishment. Until units of mass, 
length, and time were invented upon which all agreed, it 
was impossible to express weight, dimensions, and time 
in terms which would convey the same meaning to all. 
This was, to a great extent, the situation in education 
ten years ago. But the time is not far distant when, in 
many of the essential subjects, the progress of every 
pupil who enters school will be determined by objective 
methods. Thus, in a particular function such as writ- 
ing, we shall measure the ability of the pupil every six 
months from the time he enters until he leaves school. 
The same will be true of his ability in the other subjects 
which the school considers to be of importance and which 
admit of being measured by universal standards. The 
enlightened school system will have the progress of every 
child kept on a chart, a rough sample of which is given 
on the following page. 
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In this way it will be a simple matter to determine the 
exact point at which the pupil failed to advance at the 
nonnal rate in any particular line of study. The teacher 
will be able to see whether failure was confined to a par- 
ticular subject or whether it also took place in other sub- 
jects in the curriculum. If it is found that the child has 
failed in but one subject and not in the others, then we 
must assume either that the child was abnormal in that 
subject or that the method of instruction in that particu- 
lar branch was not up to the usual standard. If, in addi- 
tion to this, it is found that the majority of pupils under 
a particular teacher have failed to advance in this 
subject alone and not in others, then there is every reason 
to suppose that it was not the fault of the class but rather 
the fault of the teacher in failing to give attention to the 
subject or in usmg some method which could not produce 
the average rate of progress. Again, in the case of a 
particular pupil, it may be found that the failure to 
progress was not confined to one subject, but that it 
extended to all subjects. In this case further inquiries 
must be made. It may have been a matter of arrested 
mental development, or it may have been due to physical 
causes or to social conditions which did not admit of the 
child's spending sufficient time in school. 

Such a chart as we have shown can easily be passed on 
from school to school as the child goes from one neigh- 
borhood to another, or it can be passed from school sys- 
tem to school system or from country to country, for the 
very essence of these universal scales is that they are 
independent of place and time. School systems, under 
these conditions, will keep track of every pupil from the 
time he enters to the time he leaves. In other words, 
the administrator will cease to deal with mere groups of 
children and will deal with the individual child. 

Application of the Objective Scales to the Question of 
Promotion. Such methods of measurement will bring to 
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the question of promotion a definiteness which is sorely 
needed. It is too well known that in many school sys- 
tems a high percentage promotion does not mean a high 
standard of work, but rather a lowering of that standard 
to enable the requisite number of children to pass. As a 
result, pupils are often found in the higher grades who are 
totally unable to profit by the relatively advanced in- 
struction given. As long as the present loose methods 
of measuring school achievements are in vogue, such a 
state of affairs is inevitable; under the new system a 
radical change will be possible, for with certain exceptions 
the presence of a child in a particular grade must mean 
that he has passed certain points on the scales which 
measure the various school abilities. If these points have 
not been reached, then the pupil will not be promoted, 
for he will be unable to profit by the instruction given. 

A teacher will be able to measure the abilities of pupils 
when they are received in September, and if promotion 
has taken place in spite of bad previous records, he will 
at least know of this, and, by pointing to their records, 
will be able to free himself from criticism on account of 
their ultimate failure. The position of the efficient and 
conscientious teacher will be established, not on the 
insecure basis of the opinion of an often prejudiced super- 
visor, but on the basis of the actual work of the pupils 
judged by impartial standards. 

Application of Objective Scales to Vocational Guidance. 
Such a chart of improvement will be of great service 
when the pupil on leaving school requires vocational 
guidance. The employer will state the requirements of 
his work in the different school subjects, while the voca- 
tional guidance expert, by consulting the chari;, can deter- 
mine the extent to which the pupil measures up to these 
requirements. 

The Objective Scale as Limiting the Amount of Improve- 
ment Necessary. Again, it is true that in many subjects 
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only a certain degree of efficiency is demanded by the 
world. For example, there is no object in being able to 
write better than is required for reasonable grace and 
legibility. The handwriting of some children shows a 
wasted youth ! If time is spent beyond a certain point, 
it is relatively wasted. Yet what guarantee have we 
that when children reach this point they will no longer 
be given writing lessons? Under the present subjective 
system of measurement such a guarantee is impossible, 
and, if given, is meaningless. When the objective scale 
is used for measuring handwriting, the matter is perfectly 
simple ; for the child knows that when he reaches a cer- 
tain point on the scale, provided he keeps up to that 
point, all formal writing lessons will cease. 

Application of the Objective Scales in Rural Schools. 
These scales will find ready application in the rural schools, 
where the teacher is unable to form correct estimates of 
the work because small classes do not afford a basis for 
judgment. With the new methods which these scales 
introduce, the isolated child in the rural school can be 
compared with, and in a sense can compete with, children 
of like age in the city system. In fact, at present one of 
the authors is comparing, by means of these universal 
standards, the work of 100 rural school children of a 
given age, with a random sampling of 100 city school 
children of the same age. In a sense the results of this 
experiment will be as definite as measurements made of 
the pupils' height and weight by means of the foot-rule 
and the weighing machine. 

The Scales as Revealing the Success and Failure of School 
Methods. The purpose of these scales, in fact of the 
whole subject of educational measurements, is not, like 
the ordinary examination, to test merely the efficiency of 
the individual teacher or pupil, but rather to test the effi- 
ciency of the teaching process itself. The individuals 
are examined in many cases, not because of our interest 
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in them as individuals, but because their work will reveal 
whether the method which is being used in their instruc- 
tion is sound. Many of the failures in our schools are 
due, not to unavoidable inefficiency on the part of the 
teachers, but rather to lack of knowledge on their part 
that their efforts are failing to produce the desired results. 
Were the teachers themselves aware that they were fail- 
ing, they would certainly attempt to alter their methods. 
It is lack of definite knowledge of what the pupils are 
accomplishing, and not incompetence or indifference, 
which prevents a better adaptation of method to product 
desired. 

For this reason teachers should be willing and eager to 
submit their work to an impersonal standard, not so that 
it may be praised or condemned, but so that they them- 
selves may know whether their methods are producing 
as good results as may reasonably be expected. Teachers 
should have a more exact knowledge than they have had 
in the past of those processes which are going on in their 
pupils, for it is the changes which occur during the school 
period that must be measured. Over these changes we 
have more or less direct control ; the test of life is too re- 
mote. The application of these objective scales enables 
the teacher to know what is happening, not in terms of 
mere empty formulse which unfortunately have become 
associated with the word "method," but rather in terms 
of what the pupils can actually do as a result of the in- 
struction given them. 

Scientific measurement in education will narrow the 
limits of the wasteful trial and error method which is 
always incident to the teaching process, however con- 
scientious the teachers may be. It will also do another 
great service, for it is undeniable that, by means of these 
scales, the complacency of a small section of teachers can 
be disturbed by actually showing them their failure in 
black and white. The greatest check on inefficiency in 



any system is the knowledge that the work of each teacher 
and the work of each school can be compared with the 
work of other teachers and the work of other schools. A 
school which is confronted with indisputable evidence of 
its shortcomings is in a position to investigate causes, and 
if necessary to trace them to individuals ; such procedure 
is always the forerunner of progress. 

EXERCISES 

1. What would be the chief difflculties in conatructing a scale for 
the meaaurement of knowledge of American history in the eighth 
grade? 

2. How would you prove to an outsider that thereyare great in- 
dividual differences in ability, even in the same class? How should 
a knowledge of these individual diSerences affect (a) the amount of 
matter taught; (i) the method of instruction? 

3. What are the chief advantages of continuous school records? 
Draw up a table, and outline the methods which could be used for 
recording a. child's progress in the fundamental studies, from the time 
he ent«rs to the time he leaves school. 

4. Upon what factors should promotion depend? Have we any 
right to promote a pupil if he is not up to certain minimum stand- 
ards? How do the standard scales help to determine these minunum 
Htandarda? How does too lax a promotion system disorganize the 
work in the higher grades? 

5. Why is the present system of marking in your school an 
insuflieient guide to the quality of the work which is being done? 

6. Should all children give the same time to all atudies? In what 
way will the use of these standard testa enable us to allow the indi- 
vidual child to distribute his time in a more advantageous manner? 

7. How is a rural school teacher handicapped in judging the work 
of her pupib? Show how the scales help in this respect. 

8. A superintendent of a city school system cannot decide between 
two proposed methods of teaching handwriting. Describe a plan 
whereby, in a few years, he could decide which method was the 
better? How have such questions been decided in the past? 

9. Why is it better to measure the success of a year's work by 
the improvement of the pupils during that period, than by the final 
scores in a teat at the end of the year? If you were the principal of a 
school, outline the methods you would employ to measure such 
improvement. 



CHAPTER X 

DANGERS INCIDENTAL TO THE USE OF THESE 

SCALES 

At a time when all available pressure should be brought 
to bear on school systems to introduce objective measure- 
ment into the ordinary routine of the school, it seems 
hardly the occasion to criticise the scales. However, a 
word of caution may not be out of place as to the dangers 
which may arise from their application, since their im- 
proper use will perhaps prejudice those who make the 
first attempts at this tjrpe of measurement. 

Difficulty of Comparing Methods of Teaching. It has 
already been stated that one of the great functions of the 
scales is to compare the various methods of instruction 
employed in the teaching of a subject. Great care, how- 
ever, will have to be taken to prevent mistakes in com- 
paring the relative values of such methods when used in 
different schools or systems. To know that the work in 
a particular subject is better in one school than in another 
is not sufficient to justify the judgment that the method 
used in the one school is superior to that in the other. 
In such a comparison several secondary causes must also 
be considered before any statement is made concerning 
the relative efficiency of the methods : (1) time allowed 
in the different schools; (2) personality of the teacher; 
(3) the type of neighborhood as determining the type of 
pupil. It will be only by the most careful experimenta- 
tion, where attention is paid to these points and to many 
others of less importance, that anything like a scientific 
application of the scales to the question of the values of 
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methods will be obtained. The whole subject is full of 
danger, and many fallacies will have to be avoided. At 
the present time scientific attention is being directed 
rather to the construction and use of scales for particular 
groups than to comparison of procedure values ; but such 
comparison will be possible later, when every school sys- 
tem employs a competent statistician and experimenter 
capable of conducting genuinely scientific comparative 
experiments. In short, we must not strive to compare 
groups that are not alike or hold up standards without 
due consideration of social conditions. Mere statistics 
can never dictate final standards of achievement ; a 
standard set up may be too high for one school and not 
high enough for another. Each school, after working 
with these scales for some time, can establish standards 
of its own ; but there is always the danger that a standard 
may be set up which falls short of what should be done. 
In fact, the unwise use of standards, in this respect, may 
confirm the school in lax processes. 

Failure of Scales, from the Fact That They Measure Com- 
plex Abilities, to Reveal the Point of Weakness in Method. 
While these scales will do much to quicken methods used 
in the schools, it may be well to mention another point 
which is apt to be overlooked by some who employ such 
measurements. Thus, a scale may show that the method 
which has been used is imperfect in that it has failed to 
produce the desired product ; but it does not directly 
analyze the particular fault. The scales do not tell you 
what to do, but rather they tell you where you are. A 
teacher may be conscious that he has failed, but unable, 
in spite of great efforts, to find out the exact factor re- 
sponsible for this failure. In much the same way a phy- 
sician after examination may make the announcement 
that the organic processes are wrong, but at the same 
time be totally unable to attribute the cause. Although 
the present scales, because they measure such complex 




activities, do not reveal the exact point at which a teacher 
may have failed, yet we see in the Courtis Test the begin- 
nings of an attempt to measure the details of what many 
have considered to be a single process, namely, "arith- 
metic ability." When more analytical scales have been 
worked out in other subjects, it will be possible to go into 
detail and tell the teacher at just what point or points he 
failed, these small failures accounting for the failure in 
the wider test. The idea might also be applied to the 
testing of English composition. As things are now, it is 
possible merely to tell a teacher that the class has failed 
to produce as good English composition, as measured on 
the Hillegas Scale, as might be expected. We are not in 
a position to say what details are responsible for the 
failure. But suppose at a later time scales should be 
used to test (1) punctuation, (2) extent of vocabulary, 
(3) choice of vocabulary, (4) power of summarization, 
etc. ; then that which we now attribute perforce to general 
weakness, we shall then assign to weakness in one or 
more of these factors which can be corrected by special 
practice. In this way we shall narrow down the limits 
withua which the teaching process can fail without even 
a knowledge on the part of the teacher that it is failing. 

What the Scales Do Wot Measure. Another objection 
which may be urged against the scales is that they fail 
to take into account such factors as interest in the process 
of learning, the eagerness with which pupils will continue 
a particular study after pressure is removed, etc. The 
scale also takes no direct account of the method by which 
the product is obtained ; it does not tell the experimenter 
whether these results were secured by easy work or by 
undue pressure on the part of the teacher. The reply is 
that it is only the objectors who have ever assumed that 
the scales do measure these things. To illustrate, to an 
automobile reliability test, the measurement of speed 
does not tell us concerning the internal mechanism of the 




engine ; other tests must be used to measure this factor. 
But if a machine keeps up a high speed for a long period, 
then as a rule the internal factors cannot be much out ot 
gear. In a precisely similar manner, if a class steadily 
keeps up its improvement on a particular scale, then it is 
feasible to assume that the internal factors are not seri- 
ously wrong. In the end, bad psychological methods 
such as undue driving (which is little to be feared in 
modem education), will yield poor objective results. 
The scales, however, must not be attacked because they 
fail in many cases to measure what no competent individual 
has ever claimed they do measure. 

The use of scales also brings with it the danger that the 
teacher may sacrifice everything in the classroom to the 
production of work which can be measured objectively, 
and, as already pointed out, the scales may fail to give 
sound relative values to different elements involved in 
that work. To make this point clearer, let us consider 
for one moment a scale for the measurement of the child's 
ability to add simple numbers, such as was described in 
the Courtis test. If the norms insist upon speed, then 
the teacher will work for speed ; if the norm is one for 
accuracy, then the teacher will work for accuracy; and 
the scale itself do^ not decide to which of these two fac- 
tors the greater attention should be given. Even when 
the scale is placed in the hands of the teacher, these ques- 
tions of relative value must still be decided. However, 
in this particular respect the scales themselves will work 
out their own salvation, for, by a consensus of expert 
opinion, it will be possible to decide for any particular 
grade the amount of speed that should be required aa 
well as the degree of accuracy. 

Another point against which school systems must care- 
fully guard themselves, when these scales and standards 
are introduced, will be a tendency for schools to overlook 
those factors which do not admit of measurement by 



such objective scales. This danger will gradually be 
eliminated as time goes on and as further scales for the 
measurement of school products are worked out. In the 
meantime, merely because only certain abilities at present 
admit of measurement, the school must not overlook sub- 
jects and factors which as yet do not admit of such quan- 
titative estimation. In particular it must not fail to 
take into consideration such factors as the personal char- 
acter of the teacher, the moral atmosphere of the school, 
and other spiritual values which, like life, beauty and 
happiness, are, to say the least, difficult fields for quanti- 
tative analysis. Such spiritual values in schools are of 
the greatest importance; to overlook or underestimate 
this fact would indicate a profound lack of sense of rela- 
tive values. Even statisticians remember these things. 
But because we cannot estimate spiritual values, it is no 
reason why we should not measure values in those realms 
which admit of measurement. No science would have 
evolved, if it had not in its beginning confined itself to a 
limited field, and left large parts of the subject for the 
future. F\irthermore, there is very strong a priori evi- 
dence to suggest that there is a close correlation existing 
between spiritual values and the values which these scales 
measure. If in the things we can measure it can be shown 
that the work is inadequate, there is every reason to 
believe that in the region of spiritual values there are 
shortcomings which escape our meastiring rod. Cer- 
tainly low objective values are no great argument for high 
spiritual values ! 

The Future of Educational Measurement. Many 'of 
these tests need criticism and revision, and such questions 
as their fairness and practicability can be answered only by 
the teachers who use them. For this reason the authors 
have refrained from any detailed consideration of the 
shortcomings of the individual scales. But the time spent 
upon their application will accomplish a twofold purpose : 
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It will improve the scales themselves ; and it will give to 
every teacher who employs them a quantitative point of 
view which is sadly lacking in the schools, for many 
questions of school procedure do not admit of being 
answered by a mere affirmative or negative — the answer 
is found in the quantitative measurement. The Director 
of Reference and Research of the Department of Educa- 
tion of the City of New York says : "There could be no 
better exercise for a teachers' seminar than a series of 
discussions on some selected tests that would invite the 
Independent judgment and criticism of intelligent 
teachers." 

It is dangerous to forecast, especially when a subject is 
in its infancy, but there is every reason to believe that 
the application of the scientific method and the logic of 
statistics to educational problems will slowly revolution- 
ize the method of education, even on its philosophical 
side. Moreover, in certain branches it will raise the 
study of education to the level of an exact science, 
thereby winning the respect of the scientific world for a 
subject whose low standards of proof and loose methods 
in the past have been responsible for the stigma which 
attaches to the study of education as an academic subject 
in the school and college curriculum. 



EXERCISES 

1. When we are told that a child ia "poor" in aritfametic, what ia 
implied by this statement? Uow may we use the scales described 
to discover the point at which, and the extent to which, the individual 
is below standard ? 

2. How may the norms established for the scales actually confirm 
a school in las teaching methods? How could this evil be prevented? 

3. What other scales would he useful in the classroom? 

4. How would you start to construct a rough objective scale for 
measuring (a) moral judgment, (A) testhetic appreciation, and (c) 
humor? 
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5. How will the norms established by the use of these scales help 
greatly in settling the question of time distribution in the schedule? 

6. Why is a single survey of a school of limited value? What are 
the advantages of measuring the quality of the work every half 
year? 

7. How would you show a class the rate at which it was improv- 
ing, from month to month, in order to accelerate its progress in 
(a) spelling, (6) writing, (c) reading? 

8. How would you proceed to compare two different methods of 
teaching spelling by means of the objective scales? Enumerate the 
dangers and show how you would avoid them? 

9. It is sometimes said, "These scales do not measure the most 
important work of the school, therefore they are of little avail." 
How would you meet this criticism? 

10. How would you conduct, in a small city system, a general 
survey of the quality of the work done in the conmion subjects of the 
curriculum? 



APPENDIX 

SOURCES OF THE SCALES 

The sources, from which a full account of each of the 
scales can be obtained, are given below. 

Courtis, S. A. 
A Manual of Instmctions for Giving and Scoring the 
Courtis Standard Tests. (75 cents.) 82 Eliot Street, 
Detroit. 

This manual also includes the Courtis Handwriting and Reading 
Scales, 

The standard blanks for any of the above tests, together with full 
directions for administration and scoring of the test, may be obtained 
from Mr. S. A. Courtis at the above address. 

Thorndike, E. L. 
Handvrriting. Teachers College Record, 11: No. 2. 

1910. (30 cents.) Publication Bureau, Teachers 

College, New York City. 
Separate copies of the scale can also be secured (5 cents). 

Ayres, L. p. 
A Scale for Measuring the Qiwlity of Handwriting of 
School Children. (5 cents.) Russell Sage Founda- 
tion, New York City. 

Thorndike, E. L. 

The Meorsurement of Ability in Reading. Teachers 
College Record, 15 : No. 4, 1914. (30 cents.) Pub- 
lication Bureau, Teachers College, New York City. 

The standard blanks used in the Thorndike Tests may be procured 
in any quantity from the above address. 

189 



190 Appendix 

Starch, D. 
The Measurement of Efficiency in Reading. Journal of 
Educational Psychology, January, 1915. (30 cents.) 
Warwick and York, Inc., Baltimore. 

The standard blanks for the administration of the test may be 
obtained, in any quantity, from the author, Dr. Daniel Starch, Uni- 
versity of Wisconsin. 

Buckingham, B. R. 
Spelling Ability: Its Measurement and Distribution. 
(95 cents.) Publication Bureau, Teachers College, 
New York City. 

Starch, D. 

The Measurement of Efficiency in Spelling. Jouilial of 
Educational Psychology, March, 1915. (30 cents.) 
Warwick and York, Inc., Baltimore. 

Ayrbs, L. p. 
A Measuring Scale for Ability in Spelling. (30 cents.) 
Russell Sage Foimdation, New York City. 

Hnj^GAS, M. B. 
A Scale for the Measurement of Quality in English Cowr 
position by Young People. Teachers College Record, 
13: No. 4. 1912. (30 cents.) Publication Bureau, 
Teachers College, New York City. 

Ballou, F. W. 
Scales for the Measurement of English Composition. 
(40 cents.) The University Press, Harvard Univer- 
sity, Cambridge, Mass. 

Trabub, M. R. 
Completion Test Language Scales'. ($1.15.) Publica- 
tion Bureau, Teachers College, New York City. 

The scales described, together with the Practice Sheet, may be 
purchased in any quantity from the above address. 



